[ 635.940869] env[70006]: INFO neutron.common.config [-] Logging enabled! [ 635.941453] env[70006]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev62 [ 635.941796] env[70006]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70006) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 635.942127] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 635.942231] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 635.943102] env[70006]: WARNING oslo_policy.policy [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 635.943322] env[70006]: WARNING oslo_policy.policy [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 635.944846] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] VMware NSXv3 Agent initialized successfully. [ 635.945230] env[70006]: DEBUG oslo_concurrency.lockutils [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] Acquiring lock "singleton_lock" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.945370] env[70006]: DEBUG oslo_concurrency.lockutils [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] Acquired lock "singleton_lock" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.945605] env[70006]: DEBUG oslo_concurrency.lockutils [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] Releasing lock "singleton_lock" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.945908] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] Full set of CONF: {{(pid=70006) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 635.946044] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ******************************************************************************** {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 635.946163] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] Configuration options gathered from: {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 635.946526] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 635.946709] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 635.946827] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ================================================================================ {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 635.947010] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] agent_down_time = 75 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.947167] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] allow_automatic_dhcp_failover = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.947312] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] allow_bulk = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.947464] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] api_extensions_path = {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.947645] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] api_paste_config = api-paste.ini {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.947816] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] auth_strategy = keystone {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.947943] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] backdoor_port = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.948060] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] backdoor_socket = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.948209] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] backlog = 4096 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.948356] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] base_mac = fa:16:3e:00:00:00 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.948533] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] bind_host = 0.0.0.0 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.948706] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] bind_port = 9696 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.948845] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] client_socket_timeout = 900 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.948992] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] config_dir = [] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.949121] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.949270] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] config_source = [] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.949415] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] control_exchange = neutron {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.949563] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] core_plugin = ml2 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.949714] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] debug = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.949859] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] default_availability_zones = [] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.950087] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.950239] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] dhcp_agent_notification = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.950394] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] dhcp_agents_per_network = 1 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.950541] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] dhcp_lease_duration = 86400 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.950692] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] dhcp_load_type = networks {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.950840] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] dns_domain = openstacklocal {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.951053] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.952051] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] enable_default_route_bfd = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.952051] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] enable_default_route_ecmp = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.952051] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] enable_dvr = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.952051] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] enable_new_agents = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.952051] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.952051] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] enable_signals = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.952298] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] enable_traditional_dhcp = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.952298] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] external_dns_driver = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.952369] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] filter_validation = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.952532] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] global_physnet_mtu = 8950 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.952679] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] graceful_shutdown_timeout = 60 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.952989] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] host = cpu-1 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.953102] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] host_dvr_for_dhcp = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.953247] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] http_retries = 3 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.953399] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] instance_format = [instance: %(uuid)s] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.953545] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.953703] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ipam_driver = internal {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.953847] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ipv6_pd_enabled = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.953989] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] l3_ha = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.954149] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.954296] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] l3_ha_network_physical_name = {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.954434] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] l3_ha_network_type = {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.954579] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] log_color = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.954727] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] log_config_append = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.954871] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.955017] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] log_dir = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.955156] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] log_file = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.955269] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] log_options = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.955411] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] log_rotate_interval = 1 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.955558] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] log_rotate_interval_type = days {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.955731] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] log_rotation_type = none {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.955824] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.955923] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.956077] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.956224] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.956336] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.956476] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] max_dns_nameservers = 5 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.956617] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] max_header_line = 16384 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.956756] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] max_l3_agents_per_router = 3 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.956895] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] max_logfile_count = 30 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.957044] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] max_logfile_size_mb = 200 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.957184] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] max_subnet_host_routes = 20 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.957328] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] my_ip = 10.180.1.21 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.957471] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] my_ipv6 = ::1 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.957643] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] network_auto_schedule = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.957789] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] network_link_prefix = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.957937] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.958098] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] notify_nova_on_port_data_changes = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.958248] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] notify_nova_on_port_status_changes = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.958395] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] pagination_max_limit = -1 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.958556] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] publish_errors = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.958718] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] rate_limit_burst = 0 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.958872] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] rate_limit_except_level = CRITICAL {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.959030] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] rate_limit_interval = 0 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.959180] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] retry_until_window = 30 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.959324] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] router_distributed = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.959484] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] rpc_resources_processing_step = 20 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.959768] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] rpc_response_max_timeout = 600 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.959938] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] rpc_response_timeout = 60 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.960144] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] send_events_interval = 2 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.960540] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] service_plugins = ['router'] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.960540] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] setproctitle = on {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.960676] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] shell_completion = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.960912] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] state_path = /opt/stack/data/neutron {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.961113] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] syslog_log_facility = LOG_USER {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.961308] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] tcp_keepidle = 600 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.961467] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] transport_url = **** {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.961615] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] use_journal = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.961761] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] use_json = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.961901] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] use_ssl = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.962059] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] use_stderr = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.962216] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] use_syslog = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.962361] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] vlan_qinq = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.962503] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] vlan_transparent = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.962643] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] watch_log_file = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.962787] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] wsgi_default_pool_size = 100 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.962928] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] wsgi_keep_alive = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.963221] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.963221] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] wsgi_server_debug = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 635.963396] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_concurrency.disable_process_locking = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.963551] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.963728] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.963855] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.964021] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.964179] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.964323] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.964483] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] profiler.connection_string = messaging:// {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.964636] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] profiler.enabled = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.964787] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] profiler.es_doc_type = notification {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.964935] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] profiler.es_scroll_size = 10000 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.965139] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] profiler.es_scroll_time = 2m {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.965242] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] profiler.filter_error_trace = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.965392] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] profiler.hmac_keys = **** {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.965565] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] profiler.sentinel_service_name = mymaster {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.965723] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] profiler.socket_timeout = 0.1 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.965873] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] profiler.trace_requests = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.966028] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] profiler.trace_sqlalchemy = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.966199] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] profiler_jaeger.process_tags = {} {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.966346] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] profiler_jaeger.service_name_prefix = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.966493] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] profiler_otlp.service_name_prefix = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.966653] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_policy.enforce_new_defaults = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.966963] env[70006]: WARNING oslo_config.cfg [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 635.967135] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_policy.enforce_scope = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.967290] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_policy.policy_default_rule = default {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.967644] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.967644] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.967811] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.967958] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.968113] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.968253] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.968583] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.968583] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.968731] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.968888] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] agent.extensions = [] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.969051] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.969210] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] service_providers.service_provider = [] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.969365] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] QUOTAS.default_quota = -1 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.969521] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.969679] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] QUOTAS.quota_floatingip = 50 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.969911] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] QUOTAS.quota_network = 100 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.969964] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] QUOTAS.quota_port = 500 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.970108] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.970251] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] QUOTAS.quota_router = 10 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.970395] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] QUOTAS.quota_security_group = 10 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.970537] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.970682] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] QUOTAS.quota_subnet = 100 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.970828] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] QUOTAS.track_quota_usage = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.971069] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.971138] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep.group = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.971283] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep.helper_command = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.971422] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep.log_daemon_traceback = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.971580] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.971765] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep.thread_pool_size = 8 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.971914] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep.user = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.972081] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.972222] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_dhcp_release.group = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.972926] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_dhcp_release.helper_command = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.972926] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.972926] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.972926] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.972926] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_dhcp_release.user = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.973140] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.973194] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_ovs_vsctl.group = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.973413] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_ovs_vsctl.helper_command = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.973466] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.973611] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.973756] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.973899] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_ovs_vsctl.user = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.974052] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_namespace.capabilities = [21] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.974195] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_namespace.group = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.974333] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_namespace.helper_command = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.974477] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_namespace.log_daemon_traceback = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.974625] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.974766] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_namespace.thread_pool_size = 8 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.974907] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_namespace.user = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.975066] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_conntrack.capabilities = [12] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.975209] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_conntrack.group = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.975435] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_conntrack.helper_command = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.975512] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.975666] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.975808] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.975946] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_conntrack.user = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.976109] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_link.capabilities = [12, 21] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.976251] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_link.group = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.976389] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_link.helper_command = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.976534] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_link.log_daemon_traceback = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.976781] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.977377] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_link.thread_pool_size = 8 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.977377] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] privsep_link.user = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.977377] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.977575] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.977771] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.continue_on_failed_promotions = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.977884] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.dscp = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.978042] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.dscp_inherit = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.978202] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.force_mp_to_policy = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.978347] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.locking_coordinator_url = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.978498] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.log_agent_heartbeats = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.978644] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.logging_expire = 1 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.978798] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.978944] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.979110] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.polling_interval = 240 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.979260] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.979411] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.979585] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.report_interval = 30.0 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.979753] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.979952] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.980074] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.980221] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.sync_skew = 60 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.980370] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.synchronization_queue_size = 20 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.980516] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT.use_helper_for_ns_read = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.980669] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] SECURITYGROUP.enable_ipset = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.980825] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] SECURITYGROUP.enable_security_group = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.980977] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.981226] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.981431] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] experimental.ipv6_pd_enabled = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.981485] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ml2.extension_drivers = ['port_security'] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.981594] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ml2.external_network_type = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.981754] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.981907] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ml2.overlay_ip_version = 4 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.982181] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ml2.path_mtu = 8950 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.982242] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ml2.physical_network_mtus = {} {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.982370] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ml2.tenant_network_types = ['vlan'] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.982519] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.982674] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ml2.type_drivers = ['vlan'] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.982829] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT_CLI.neutron_port_id = [] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.982974] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.983129] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.983301] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.983431] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.983582] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.983820] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.983973] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.984145] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.984361] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.984522] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_login_password = **** {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.984680] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_login_port = 443 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.985318] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_login_user = admin {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.985318] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.985318] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.985318] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.985486] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.985666] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.985722] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.985853] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.986045] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.986154] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.986307] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.986463] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.986621] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.986780] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.987064] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.987160] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] vsphere.vsphere_login_password = VMware1! {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.987710] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.987710] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.987710] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] nova.auth_section = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.987868] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] nova.auth_type = password {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.987916] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.988070] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] nova.certfile = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.988218] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] nova.collect_timing = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.988370] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] nova.endpoint_type = public {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.988515] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] nova.insecure = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.988655] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] nova.keyfile = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.988805] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] nova.region_name = RegionOne {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.989034] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] nova.split_loggers = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.989091] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] nova.timeout = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.989243] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] placement.auth_section = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.989405] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] placement.auth_type = password {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.989539] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.989681] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] placement.certfile = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.989828] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] placement.collect_timing = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.989975] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] placement.endpoint_type = public {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.990119] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] placement.insecure = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.990263] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] placement.keyfile = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.990429] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] placement.region_name = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.990539] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] placement.split_loggers = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.990678] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] placement.timeout = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.990826] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.auth_section = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.990969] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.auth_type = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.991118] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.cafile = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.991256] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.certfile = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.991399] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.collect_timing = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.991538] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.connect_retries = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.991678] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.connect_retry_delay = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.991840] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.enable_notifications = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.991957] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.endpoint_override = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.992108] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.insecure = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.992247] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.interface = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.992382] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.keyfile = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.992524] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.max_version = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.992664] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.min_version = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.992802] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.region_name = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.992942] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.retriable_status_codes = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.993094] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.service_name = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.993235] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.service_type = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.993378] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.split_loggers = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.993517] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.status_code_retries = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.993660] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.status_code_retry_delay = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.993796] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.timeout = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.993939] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.valid_interfaces = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.994083] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ironic.version = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.994232] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] cli_script.dry_run = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.994385] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.994526] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.994671] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.994812] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.994953] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.995106] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.995252] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.995396] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.995541] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.995692] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.995830] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.995983] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.996318] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.996318] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.996488] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.996642] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.997081] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.997081] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.997081] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.997221] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.997355] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.997500] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.997710] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.997811] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.997969] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.998122] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.998251] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.998563] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.998563] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.998692] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.998855] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.ssl = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.999019] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.999166] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.999312] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.999460] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.999607] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.999753] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 635.999906] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_notifications.driver = [] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 636.000062] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_notifications.retry = -1 {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 636.000232] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 636.000362] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 636.000477] env[70006]: DEBUG oslo_service.backend.eventlet.service [None req-8c27d14d-bbe4-4cca-840c-e48edc7991e9 None None] ******************************************************************************** {{(pid=70006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 636.001511] env[70006]: DEBUG neutron.agent.securitygroups_rpc [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Init firewall settings (driver=nsxv3) {{(pid=70006) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 636.002858] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=70006) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 636.003123] env[70006]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] RPC agent_id: nsxm-l-01a.corp.local [ 636.005389] env[70006]: DEBUG dogpile.cache.region [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 636.005516] env[70006]: DEBUG dogpile.lock [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.005621] env[70006]: DEBUG dogpile.lock [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.005718] env[70006]: DEBUG dogpile.lock [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.005817] env[70006]: DEBUG dogpile.cache.region [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 636.005910] env[70006]: DEBUG dogpile.lock [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.006050] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.036485] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Session token - acquiring [ 636.038139] env[70006]: DEBUG networking_nsxv3.common.locking [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.038319] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.038422] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.038839] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.049397] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.323754] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 636.345656] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.345807] env[70006]: DEBUG dogpile.cache.region [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Cache value generated in 0.340 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 636.345942] env[70006]: DEBUG dogpile.lock [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.346086] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Activating Policy API Provider. [ 636.346275] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Looking for the default Infrastructure Rules. [ 636.413055] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Looking for the Default Layer3 Logged Drop Section. [ 636.427577] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 636.427841] env[70006]: DEBUG networking_nsxv3.common.locking [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.428031] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquiring lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.428144] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.428434] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired external semaphore "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.428875] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.945580] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.448375] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.952024] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Inventory metadata is going to be refreshed. [ 637.952024] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 638.784019] env[70006]: DEBUG networking_nsxv3.common.locking [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.784019] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.784019] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.784019] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.794132] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 638.795348] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.796466] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 638.816278] env[70006]: DEBUG networking_nsxv3.common.locking [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.816890] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.819018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.819018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.819018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.819018] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 638.819018] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 638.819018] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 638.839903] env[70006]: DEBUG networking_nsxv3.common.locking [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.840564] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.842102] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.842102] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.842102] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.842102] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 638.866285] env[70006]: DEBUG networking_nsxv3.common.locking [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.866884] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.867168] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.869017] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.869017] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.869017] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 638.888452] env[70006]: DEBUG networking_nsxv3.common.locking [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.889113] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquiring lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.891018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.891018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired external semaphore "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.891018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Releasing lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.891018] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 638.891018] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 638.891018] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 638.909921] env[70006]: DEBUG networking_nsxv3.common.locking [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.910556] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquiring lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.910895] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.911338] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired external semaphore "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.911641] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Releasing lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.913018] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 638.913018] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 638.913018] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 638.932194] env[70006]: DEBUG networking_nsxv3.common.locking [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.934017] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.934017] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.934017] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.934017] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.934017] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 638.934017] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 638.934017] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Inventory metadata have been refreshed. [ 638.934017] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Dryrun:True. Metadata refresh completed. [ 638.934430] env[70006]: DEBUG oslo_concurrency.lockutils [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Releasing lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.938094] env[70006]: INFO neutron.agent.agent_extensions_manager [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Loaded agent extensions: [] [ 638.938094] env[70006]: DEBUG neutron_lib.callbacks.manager [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=70006) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 639.008721] env[70006]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] NSXv3 Agent Agent RPC Daemon Started! [ 639.009387] env[70006]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] NSXv3 Agent Agent loop - iteration:0 started [ 639.009387] env[70006]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] NSXv3 Agent Agent out of sync with plugin! [ 643.938409] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 643.938897] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 648.940099] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 648.940447] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 653.941349] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 653.941693] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 653.974559] env[70006]: INFO networking_nsxv3.common.synchronization [None req-a6268283-83ce-4608-ba1a-23cfd0a1a0df demo admin] Enqueued Resource ID: bd128a04-7981-4d18-af28-819f6e2d4b1d with Priority: HIGHEST for action security_group_rules [ 653.975220] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd128a04-7981-4d18-af28-819f6e2d4b1d with Priority: HIGHEST for action security_group_rules [ 653.975639] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd128a04-7981-4d18-af28-819f6e2d4b1d taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.975874] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd128a04-7981-4d18-af28-819f6e2d4b1d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.975989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd128a04-7981-4d18-af28-819f6e2d4b1d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.976442] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd128a04-7981-4d18-af28-819f6e2d4b1d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.976615] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd128a04-7981-4d18-af28-819f6e2d4b1d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.498657] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.498904] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.498904] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.499129] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.499356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.499356] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd128a04-7981-4d18-af28-819f6e2d4b1d already deleted. [ 654.499434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd128a04-7981-4d18-af28-819f6e2d4b1d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.976431] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 658.976789] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 663.978646] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 663.978646] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 668.979499] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 668.979835] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 673.980469] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 673.980845] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 678.982264] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 678.982648] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 682.210482] env[70006]: INFO networking_nsxv3.common.synchronization [None req-9393cf37-f580-461b-80e5-b1fd051fb122 None None] Enqueued Resource ID: c6808ab9-ca91-4d07-978d-28d1cb767bfd with Priority: HIGHEST for action port [ 682.211068] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6808ab9-ca91-4d07-978d-28d1cb767bfd with Priority: HIGHEST for action port [ 682.211637] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6808ab9-ca91-4d07-978d-28d1cb767bfd taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.211775] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6808ab9-ca91-4d07-978d-28d1cb767bfd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.211846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6808ab9-ca91-4d07-978d-28d1cb767bfd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.212331] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6808ab9-ca91-4d07-978d-28d1cb767bfd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.212425] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6808ab9-ca91-4d07-978d-28d1cb767bfd',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.715491] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6808ab9-ca91-4d07-978d-28d1cb767bfd [ 682.715920] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.716124] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.716215] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.716431] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.716531] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.716628] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6808ab9-ca91-4d07-978d-28d1cb767bfd already deleted. [ 682.716711] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6808ab9-ca91-4d07-978d-28d1cb767bfd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.369539] env[70006]: INFO networking_nsxv3.common.synchronization [None req-af004539-66df-4a2d-8524-527edcc34e3a None None] Enqueued Resource ID: 20dbe5ee-0bae-40a7-bc27-fa8a4e30df5a with Priority: HIGHEST for action port [ 684.369539] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20dbe5ee-0bae-40a7-bc27-fa8a4e30df5a with Priority: HIGHEST for action port [ 684.370516] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-20dbe5ee-0bae-40a7-bc27-fa8a4e30df5a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.370721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20dbe5ee-0bae-40a7-bc27-fa8a4e30df5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.370763] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20dbe5ee-0bae-40a7-bc27-fa8a4e30df5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.371122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20dbe5ee-0bae-40a7-bc27-fa8a4e30df5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.371220] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20dbe5ee-0bae-40a7-bc27-fa8a4e30df5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.650605] env[70006]: INFO networking_nsxv3.common.synchronization [None req-3ea5bf5b-62cb-4a61-a5fd-eccde352fe4c None None] Enqueued Resource ID: 422ef3be-34c6-4912-bde5-2f496878d62b with Priority: HIGHEST for action port [ 684.650605] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 422ef3be-34c6-4912-bde5-2f496878d62b with Priority: HIGHEST for action port [ 684.652581] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-422ef3be-34c6-4912-bde5-2f496878d62b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.653228] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-422ef3be-34c6-4912-bde5-2f496878d62b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.653228] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-422ef3be-34c6-4912-bde5-2f496878d62b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.653584] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-422ef3be-34c6-4912-bde5-2f496878d62b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.653770] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('422ef3be-34c6-4912-bde5-2f496878d62b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.873729] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20dbe5ee-0bae-40a7-bc27-fa8a4e30df5a [ 684.873801] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.873905] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.874094] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.874231] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.874330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.874431] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20dbe5ee-0bae-40a7-bc27-fa8a4e30df5a already deleted. [ 684.874530] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20dbe5ee-0bae-40a7-bc27-fa8a4e30df5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.943936] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.943936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.943936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.943936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.943936] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.157503] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 422ef3be-34c6-4912-bde5-2f496878d62b [ 685.157567] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.157706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.157774] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.157981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.158090] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.158193] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:422ef3be-34c6-4912-bde5-2f496878d62b already deleted. [ 685.158279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-422ef3be-34c6-4912-bde5-2f496878d62b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.446368] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.536811] env[70006]: INFO networking_nsxv3.common.synchronization [None req-100408b1-8ea3-4f2b-bb18-90d88a7ded71 None None] Enqueued Resource ID: e657fd10-22c9-4608-95cb-cc2e6144e733 with Priority: HIGHEST for action port [ 685.537087] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e657fd10-22c9-4608-95cb-cc2e6144e733 with Priority: HIGHEST for action port [ 685.537657] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-e657fd10-22c9-4608-95cb-cc2e6144e733 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.537788] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e657fd10-22c9-4608-95cb-cc2e6144e733" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.538713] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e657fd10-22c9-4608-95cb-cc2e6144e733" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.538713] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e657fd10-22c9-4608-95cb-cc2e6144e733" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.538713] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e657fd10-22c9-4608-95cb-cc2e6144e733',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.950631] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.043445] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e657fd10-22c9-4608-95cb-cc2e6144e733 [ 686.043445] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.043445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.043445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.043445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.043445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.043445] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e657fd10-22c9-4608-95cb-cc2e6144e733 already deleted. [ 686.043445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e657fd10-22c9-4608-95cb-cc2e6144e733" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.457183] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 686.457505] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 687.170871] env[70006]: INFO networking_nsxv3.common.synchronization [None req-de79dbe6-4992-4000-977f-d9b7be680c74 None None] Enqueued Resource ID: a7c6ec2f-09da-4652-8032-a7ceb4c842c4 with Priority: HIGHEST for action port [ 687.170871] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7c6ec2f-09da-4652-8032-a7ceb4c842c4 with Priority: HIGHEST for action port [ 687.170871] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7c6ec2f-09da-4652-8032-a7ceb4c842c4 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.170871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7c6ec2f-09da-4652-8032-a7ceb4c842c4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.170871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7c6ec2f-09da-4652-8032-a7ceb4c842c4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.174446] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7c6ec2f-09da-4652-8032-a7ceb4c842c4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.176040] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7c6ec2f-09da-4652-8032-a7ceb4c842c4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.294426] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.294426] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.294740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.294740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.311587] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 687.312678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.314648] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 687.333944] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.334102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.334194] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.334387] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.334471] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.334585] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 687.334653] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 687.334722] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 687.364810] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.364810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.364810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.365093] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.365093] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.365301] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 687.403014] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.403014] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.403014] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.403014] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.403014] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.403014] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 687.436041] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.436234] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.436288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.436503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.436604] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.436722] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 687.436791] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 687.438455] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 687.455980] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.455980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.455980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.456354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.456354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.456410] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 687.456444] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 687.456729] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 687.469401] env[70006]: INFO networking_nsxv3.common.synchronization [None req-fb46070f-fc65-4682-a163-ec038daff91e None None] Enqueued Resource ID: dcd1aba7-061c-49a1-a951-e8af54d45012 with Priority: HIGHEST for action port [ 687.470205] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcd1aba7-061c-49a1-a951-e8af54d45012 with Priority: HIGHEST for action port [ 687.470767] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcd1aba7-061c-49a1-a951-e8af54d45012 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.470899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcd1aba7-061c-49a1-a951-e8af54d45012" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.470969] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcd1aba7-061c-49a1-a951-e8af54d45012" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.471951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcd1aba7-061c-49a1-a951-e8af54d45012" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.473318] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcd1aba7-061c-49a1-a951-e8af54d45012',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.482983] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.482983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.482983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.482983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.482983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.483424] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 687.483622] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 687.483746] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 687.483954] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 687.483954] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 687.483954] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 687.484131] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 687.484311] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 687.484504] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 687.484504] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 687.507632] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.507632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.507632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.507901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.507901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.507955] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 687.528978] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.530315] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.530479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.530697] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.530808] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.550751] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.653318] env[70006]: INFO networking_nsxv3.common.synchronization [None req-e0eb66c5-77a2-4569-9ac6-9ac38caf572c None None] Enqueued Resource ID: b6f3dbf1-bcab-48d0-976e-9c07fab6745a with Priority: HIGHEST for action port [ 687.653874] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6f3dbf1-bcab-48d0-976e-9c07fab6745a with Priority: HIGHEST for action port [ 687.654209] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6f3dbf1-bcab-48d0-976e-9c07fab6745a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.654328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6f3dbf1-bcab-48d0-976e-9c07fab6745a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.654395] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6f3dbf1-bcab-48d0-976e-9c07fab6745a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.656221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6f3dbf1-bcab-48d0-976e-9c07fab6745a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.656221] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6f3dbf1-bcab-48d0-976e-9c07fab6745a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.678912] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7c6ec2f-09da-4652-8032-a7ceb4c842c4 [ 687.679249] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.679397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.679557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.679789] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.679942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.681227] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7c6ec2f-09da-4652-8032-a7ceb4c842c4 already deleted. [ 687.681227] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7c6ec2f-09da-4652-8032-a7ceb4c842c4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.975739] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dcd1aba7-061c-49a1-a951-e8af54d45012 [ 687.975739] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.975739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.975739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.975739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.975739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.975739] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dcd1aba7-061c-49a1-a951-e8af54d45012 already deleted. [ 687.975739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcd1aba7-061c-49a1-a951-e8af54d45012" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.158438] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6f3dbf1-bcab-48d0-976e-9c07fab6745a [ 688.160437] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.160637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.160700] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.160865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.160944] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.161059] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6f3dbf1-bcab-48d0-976e-9c07fab6745a already deleted. [ 688.161160] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6f3dbf1-bcab-48d0-976e-9c07fab6745a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.343073] env[70006]: INFO networking_nsxv3.common.synchronization [None req-f3fa125c-edbb-4c4a-b84b-af0938ad2798 None None] Enqueued Resource ID: 2355def1-cd02-4e9a-9b19-62b7a0c8632f with Priority: HIGHEST for action port [ 688.343823] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2355def1-cd02-4e9a-9b19-62b7a0c8632f with Priority: HIGHEST for action port [ 688.344166] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-2355def1-cd02-4e9a-9b19-62b7a0c8632f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.346699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2355def1-cd02-4e9a-9b19-62b7a0c8632f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.346699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2355def1-cd02-4e9a-9b19-62b7a0c8632f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.346699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2355def1-cd02-4e9a-9b19-62b7a0c8632f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.346699] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2355def1-cd02-4e9a-9b19-62b7a0c8632f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.648027] env[70006]: INFO networking_nsxv3.common.synchronization [None req-f409c062-0276-4027-80ee-d6bc52d2a048 None None] Enqueued Resource ID: 0a43e5ec-8387-403e-80f9-c4b9647b9de0 with Priority: HIGHEST for action port [ 688.648848] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a43e5ec-8387-403e-80f9-c4b9647b9de0 with Priority: HIGHEST for action port [ 688.649861] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a43e5ec-8387-403e-80f9-c4b9647b9de0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.650721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a43e5ec-8387-403e-80f9-c4b9647b9de0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.650721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a43e5ec-8387-403e-80f9-c4b9647b9de0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.650721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a43e5ec-8387-403e-80f9-c4b9647b9de0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.650721] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a43e5ec-8387-403e-80f9-c4b9647b9de0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.852778] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2355def1-cd02-4e9a-9b19-62b7a0c8632f [ 688.852778] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.852778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.852778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.852778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.852778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.852778] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2355def1-cd02-4e9a-9b19-62b7a0c8632f already deleted. [ 688.852778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2355def1-cd02-4e9a-9b19-62b7a0c8632f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.152788] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a43e5ec-8387-403e-80f9-c4b9647b9de0 [ 689.153245] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.154313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.154313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.154584] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.154658] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.154716] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a43e5ec-8387-403e-80f9-c4b9647b9de0 already deleted. [ 689.154795] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a43e5ec-8387-403e-80f9-c4b9647b9de0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.262831] env[70006]: INFO networking_nsxv3.common.synchronization [None req-e812e445-0c0d-4e90-a0e6-2f4660ae662d tempest-ServerActionsTestJSON-71305913 tempest-ServerActionsTestJSON-71305913-project-member] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_rules [ 689.263263] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_rules [ 689.263583] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.263679] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.263762] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.266483] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.266603] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.392789] env[70006]: INFO networking_nsxv3.common.synchronization [None req-6ee17d14-3f0c-47f5-9092-e932e452b427 tempest-ServerActionsTestJSON-71305913 tempest-ServerActionsTestJSON-71305913-project-member] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_rules [ 689.393624] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_rules [ 689.394770] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.394853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.458542] env[70006]: INFO networking_nsxv3.common.synchronization [None req-349f24f1-6e34-4d88-b9bd-58f6c9b42e4e None None] Enqueued Resource ID: 92115b58-5108-4f12-a336-f899564b6bad with Priority: HIGHEST for action port [ 689.458793] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92115b58-5108-4f12-a336-f899564b6bad with Priority: HIGHEST for action port [ 689.459402] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-92115b58-5108-4f12-a336-f899564b6bad taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.459535] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92115b58-5108-4f12-a336-f899564b6bad" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.460475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92115b58-5108-4f12-a336-f899564b6bad" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.460475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92115b58-5108-4f12-a336-f899564b6bad" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.460475] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92115b58-5108-4f12-a336-f899564b6bad',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.792782] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.793439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.793631] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.794068] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.794373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.794565] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c already deleted. [ 689.794767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.795068] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.795450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.799282] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.966729] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92115b58-5108-4f12-a336-f899564b6bad [ 689.966729] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.966824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.966862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.967105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.967195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.967289] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92115b58-5108-4f12-a336-f899564b6bad already deleted. [ 689.967370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92115b58-5108-4f12-a336-f899564b6bad" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.214955] env[70006]: INFO networking_nsxv3.common.synchronization [None req-6da57190-4dbd-463f-8376-15d4ce721ca7 None None] Enqueued Resource ID: f371b8e4-02c0-4631-8368-d042be7e3f40 with Priority: HIGHEST for action port [ 690.216461] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f371b8e4-02c0-4631-8368-d042be7e3f40 with Priority: HIGHEST for action port [ 690.217079] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-f371b8e4-02c0-4631-8368-d042be7e3f40 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.217219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f371b8e4-02c0-4631-8368-d042be7e3f40" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.217331] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f371b8e4-02c0-4631-8368-d042be7e3f40" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.217560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f371b8e4-02c0-4631-8368-d042be7e3f40" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.217625] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f371b8e4-02c0-4631-8368-d042be7e3f40',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.320670] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.320914] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.321041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.322340] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.322506] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.322644] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c already deleted. [ 690.322746] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.722625] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f371b8e4-02c0-4631-8368-d042be7e3f40 [ 690.722873] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.723030] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.723100] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.726124] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.726295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.726495] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f371b8e4-02c0-4631-8368-d042be7e3f40 already deleted. [ 690.726495] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f371b8e4-02c0-4631-8368-d042be7e3f40" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.081295] env[70006]: INFO networking_nsxv3.common.synchronization [None req-6db5547b-fde8-48d3-b6e4-cd061ea909dd None None] Enqueued Resource ID: fbd92521-0f84-46f9-b0fe-6245bd559c37 with Priority: HIGHEST for action port [ 691.083846] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbd92521-0f84-46f9-b0fe-6245bd559c37 with Priority: HIGHEST for action port [ 691.083846] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbd92521-0f84-46f9-b0fe-6245bd559c37 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.084313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbd92521-0f84-46f9-b0fe-6245bd559c37" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.084313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbd92521-0f84-46f9-b0fe-6245bd559c37" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.084423] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbd92521-0f84-46f9-b0fe-6245bd559c37" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.084453] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbd92521-0f84-46f9-b0fe-6245bd559c37',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.181080] env[70006]: INFO networking_nsxv3.common.synchronization [None req-f259255a-aed4-4f01-ad45-182c803f548d None None] Enqueued Resource ID: 3b821903-d3bb-4879-8f08-58314efcb28a with Priority: HIGHEST for action port [ 691.182085] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b821903-d3bb-4879-8f08-58314efcb28a with Priority: HIGHEST for action port [ 691.182085] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b821903-d3bb-4879-8f08-58314efcb28a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.182085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b821903-d3bb-4879-8f08-58314efcb28a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.182256] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b821903-d3bb-4879-8f08-58314efcb28a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.182712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b821903-d3bb-4879-8f08-58314efcb28a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.182712] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b821903-d3bb-4879-8f08-58314efcb28a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.587260] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbd92521-0f84-46f9-b0fe-6245bd559c37 [ 691.587667] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.589166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.589166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.589166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.589166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.589166] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbd92521-0f84-46f9-b0fe-6245bd559c37 already deleted. [ 691.589166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbd92521-0f84-46f9-b0fe-6245bd559c37" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.688518] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b821903-d3bb-4879-8f08-58314efcb28a [ 691.688770] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.688909] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.689058] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.689205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.689307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.689492] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b821903-d3bb-4879-8f08-58314efcb28a already deleted. [ 691.690101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b821903-d3bb-4879-8f08-58314efcb28a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.066819] env[70006]: INFO networking_nsxv3.common.synchronization [None req-e34133b0-32a3-43ec-86bb-56ea07458ccf None None] Enqueued Resource ID: 2a9b72c0-3883-4d20-914b-81daedd03eb4 with Priority: HIGHEST for action port [ 692.067929] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a9b72c0-3883-4d20-914b-81daedd03eb4 with Priority: HIGHEST for action port [ 692.068269] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a9b72c0-3883-4d20-914b-81daedd03eb4 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.068393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a9b72c0-3883-4d20-914b-81daedd03eb4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.068461] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a9b72c0-3883-4d20-914b-81daedd03eb4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.068711] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a9b72c0-3883-4d20-914b-81daedd03eb4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.068791] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a9b72c0-3883-4d20-914b-81daedd03eb4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.114982] env[70006]: INFO networking_nsxv3.common.synchronization [req-ae7e64fc-630f-4bcc-8823-c631207526f0 req-84d92795-3121-43e9-b63b-7780b13e5599 tempest-ServerDiagnosticsTest-1436260678 tempest-ServerDiagnosticsTest-1436260678-project-member] Enqueued Resource ID: a36672b1-ead4-4521-bd0d-2babb803d619 with Priority: HIGHEST for action security_group_members [ 692.115633] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a36672b1-ead4-4521-bd0d-2babb803d619 with Priority: HIGHEST for action security_group_members [ 692.116575] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a36672b1-ead4-4521-bd0d-2babb803d619 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.116575] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.116575] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.118941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.119247] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.119467] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.119540] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.119718] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.119807] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.119907] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a36672b1-ead4-4521-bd0d-2babb803d619',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.284484] env[70006]: INFO networking_nsxv3.common.synchronization [None req-68452506-c865-4e21-b8fa-bea0b1d1daf7 None None] Enqueued Resource ID: 091ee846-c157-4184-b09c-2ff5375e3c8e with Priority: HIGHEST for action port [ 692.284829] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091ee846-c157-4184-b09c-2ff5375e3c8e with Priority: HIGHEST for action port [ 692.285256] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-091ee846-c157-4184-b09c-2ff5375e3c8e taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.285597] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-091ee846-c157-4184-b09c-2ff5375e3c8e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.285597] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-091ee846-c157-4184-b09c-2ff5375e3c8e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.285745] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-091ee846-c157-4184-b09c-2ff5375e3c8e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.285835] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('091ee846-c157-4184-b09c-2ff5375e3c8e',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.572577] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a9b72c0-3883-4d20-914b-81daedd03eb4 [ 692.572964] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.573288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.573288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.573453] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.573540] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.573641] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a9b72c0-3883-4d20-914b-81daedd03eb4 already deleted. [ 692.573721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a9b72c0-3883-4d20-914b-81daedd03eb4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.623666] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.623846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.623916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.624233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.624329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.624531] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.624624] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.624685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.625015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.625015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.625015] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a36672b1-ead4-4521-bd0d-2babb803d619 already deleted. [ 692.625125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.792407] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 091ee846-c157-4184-b09c-2ff5375e3c8e [ 692.792407] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.792407] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.792407] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.792407] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.792407] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.792407] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:091ee846-c157-4184-b09c-2ff5375e3c8e already deleted. [ 692.792407] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-091ee846-c157-4184-b09c-2ff5375e3c8e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.925736] env[70006]: INFO networking_nsxv3.common.synchronization [None req-34213d01-d320-4ec1-8553-14656f394e06 None None] Enqueued Resource ID: 30eb7c1b-cd81-4929-9118-554130e57c98 with Priority: HIGHEST for action port [ 693.927363] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30eb7c1b-cd81-4929-9118-554130e57c98 with Priority: HIGHEST for action port [ 693.927833] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-30eb7c1b-cd81-4929-9118-554130e57c98 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.928079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30eb7c1b-cd81-4929-9118-554130e57c98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.928079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30eb7c1b-cd81-4929-9118-554130e57c98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.928353] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30eb7c1b-cd81-4929-9118-554130e57c98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.928462] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30eb7c1b-cd81-4929-9118-554130e57c98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.054750] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.054750] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.054750] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.054997] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.056245] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.057096] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.057278] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.057710] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.057929] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.058480] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.058480] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.058591] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.058700] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.058947] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.059113] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.059261] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.082515] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.082945] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 694.083175] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.083287] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.084380] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-ecf33e4a-0e1b-41fe-b723-bd679a50d3a0 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.084583] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-ecf33e4a-0e1b-41fe-b723-bd679a50d3a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.084715] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-ecf33e4a-0e1b-41fe-b723-bd679a50d3a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.085324] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-ecf33e4a-0e1b-41fe-b723-bd679a50d3a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.085324] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecf33e4a-0e1b-41fe-b723-bd679a50d3a0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.368295] env[70006]: INFO networking_nsxv3.common.synchronization [None req-9575113e-026b-4da3-95ff-2098d89fbdce None None] Enqueued Resource ID: cb4d38ea-99d8-4d8e-86e2-eb73e12edddb with Priority: HIGHEST for action port [ 694.368955] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb4d38ea-99d8-4d8e-86e2-eb73e12edddb with Priority: HIGHEST for action port [ 694.369286] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb4d38ea-99d8-4d8e-86e2-eb73e12edddb taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.369413] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb4d38ea-99d8-4d8e-86e2-eb73e12edddb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.369478] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb4d38ea-99d8-4d8e-86e2-eb73e12edddb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.369730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb4d38ea-99d8-4d8e-86e2-eb73e12edddb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.369814] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb4d38ea-99d8-4d8e-86e2-eb73e12edddb',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.431835] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30eb7c1b-cd81-4929-9118-554130e57c98 [ 694.431835] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.431835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.431835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.432067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.432067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.432160] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30eb7c1b-cd81-4929-9118-554130e57c98 already deleted. [ 694.432290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30eb7c1b-cd81-4929-9118-554130e57c98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.588277] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.590234] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.590449] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.590760] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.590929] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.591106] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port ecf33e4a-0e1b-41fe-b723-bd679a50d3a0 not found, creating... [ 694.591398] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.591585] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.591691] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.591916] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.592067] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.592470] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.592628] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.592746] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.592957] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.597168] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.597374] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: ecf33e4a-0e1b-41fe-b723-bd679a50d3a0 is going to be created. [ 694.624511] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.624757] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.624855] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.625220] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.625410] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.625646] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-ecf33e4a-0e1b-41fe-b723-bd679a50d3a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.872462] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb4d38ea-99d8-4d8e-86e2-eb73e12edddb [ 694.872706] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.874622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.874622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.874622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.874622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.874622] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb4d38ea-99d8-4d8e-86e2-eb73e12edddb already deleted. [ 694.874622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb4d38ea-99d8-4d8e-86e2-eb73e12edddb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.271943] env[70006]: INFO networking_nsxv3.common.synchronization [None req-9202f625-33e8-4609-b818-56bf5367078a None None] Enqueued Resource ID: 30339461-ee60-42a6-bb47-f5658f7b3248 with Priority: HIGHEST for action port [ 695.272276] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30339461-ee60-42a6-bb47-f5658f7b3248 with Priority: HIGHEST for action port [ 695.274497] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-30339461-ee60-42a6-bb47-f5658f7b3248 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.274765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30339461-ee60-42a6-bb47-f5658f7b3248" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.274922] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30339461-ee60-42a6-bb47-f5658f7b3248" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.275607] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30339461-ee60-42a6-bb47-f5658f7b3248" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.275607] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30339461-ee60-42a6-bb47-f5658f7b3248',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.783806] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30339461-ee60-42a6-bb47-f5658f7b3248 [ 695.783806] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.783806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.783806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.783806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.783806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.783806] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30339461-ee60-42a6-bb47-f5658f7b3248 already deleted. [ 695.783806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30339461-ee60-42a6-bb47-f5658f7b3248" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.897350] env[70006]: INFO networking_nsxv3.common.synchronization [None req-3e2bcd36-8e29-4bbe-aa7f-7b030a34c55b None None] Enqueued Resource ID: 3b21c400-965a-49da-8a78-e3d2e5082c58 with Priority: HIGHEST for action port [ 695.897645] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b21c400-965a-49da-8a78-e3d2e5082c58 with Priority: HIGHEST for action port [ 695.899913] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b21c400-965a-49da-8a78-e3d2e5082c58 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.900115] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b21c400-965a-49da-8a78-e3d2e5082c58" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.900531] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b21c400-965a-49da-8a78-e3d2e5082c58" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.900531] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b21c400-965a-49da-8a78-e3d2e5082c58" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.902967] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b21c400-965a-49da-8a78-e3d2e5082c58',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.948626] env[70006]: INFO networking_nsxv3.common.synchronization [None req-178b7ae8-dc0f-4c9b-a760-92d7b3ede082 None None] Enqueued Resource ID: 3909b1e3-5a8b-4178-b6d2-86e6b78a32ca with Priority: HIGHEST for action port [ 695.948902] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3909b1e3-5a8b-4178-b6d2-86e6b78a32ca with Priority: HIGHEST for action port [ 695.949136] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-3909b1e3-5a8b-4178-b6d2-86e6b78a32ca taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.949260] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3909b1e3-5a8b-4178-b6d2-86e6b78a32ca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.950282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3909b1e3-5a8b-4178-b6d2-86e6b78a32ca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.950282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3909b1e3-5a8b-4178-b6d2-86e6b78a32ca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.950282] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3909b1e3-5a8b-4178-b6d2-86e6b78a32ca',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.403693] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b21c400-965a-49da-8a78-e3d2e5082c58 [ 696.403693] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.403693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.403693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.403693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.403693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.403693] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b21c400-965a-49da-8a78-e3d2e5082c58 already deleted. [ 696.403693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b21c400-965a-49da-8a78-e3d2e5082c58" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.455553] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3909b1e3-5a8b-4178-b6d2-86e6b78a32ca [ 696.455951] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.456371] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.456626] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.458828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.458828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.458828] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3909b1e3-5a8b-4178-b6d2-86e6b78a32ca already deleted. [ 696.458828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3909b1e3-5a8b-4178-b6d2-86e6b78a32ca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.714642] env[70006]: INFO networking_nsxv3.common.synchronization [req-ae7e64fc-630f-4bcc-8823-c631207526f0 req-b05b4a4b-8122-4fb9-afc6-52592726acf1 service nova] Enqueued Resource ID: a36672b1-ead4-4521-bd0d-2babb803d619 with Priority: HIGHEST for action security_group_rules [ 696.714734] env[70006]: INFO networking_nsxv3.common.synchronization [req-ae7e64fc-630f-4bcc-8823-c631207526f0 req-b05b4a4b-8122-4fb9-afc6-52592726acf1 service nova] Enqueued Resource ID: a36672b1-ead4-4521-bd0d-2babb803d619 with Priority: HIGHEST for action security_group_members [ 696.714901] env[70006]: INFO networking_nsxv3.common.synchronization [req-ae7e64fc-630f-4bcc-8823-c631207526f0 req-b05b4a4b-8122-4fb9-afc6-52592726acf1 service nova] Enqueued Resource ID: ecf33e4a-0e1b-41fe-b723-bd679a50d3a0 with Priority: HIGHEST for action port [ 696.715057] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a36672b1-ead4-4521-bd0d-2babb803d619 with Priority: HIGHEST for action security_group_rules [ 696.715192] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a36672b1-ead4-4521-bd0d-2babb803d619 with Priority: HIGHEST for action security_group_members [ 696.715278] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf33e4a-0e1b-41fe-b723-bd679a50d3a0 with Priority: HIGHEST for action port [ 696.715880] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a36672b1-ead4-4521-bd0d-2babb803d619 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.716011] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.717908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.718225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.718321] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a36672b1-ead4-4521-bd0d-2babb803d619',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.720561] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a36672b1-ead4-4521-bd0d-2babb803d619 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.720689] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.720756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.720942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.721429] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.721429] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.721429] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.721429] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.721611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.721611] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a36672b1-ead4-4521-bd0d-2babb803d619',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.725217] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecf33e4a-0e1b-41fe-b723-bd679a50d3a0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.725217] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecf33e4a-0e1b-41fe-b723-bd679a50d3a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.725359] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecf33e4a-0e1b-41fe-b723-bd679a50d3a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.725403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecf33e4a-0e1b-41fe-b723-bd679a50d3a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.725483] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecf33e4a-0e1b-41fe-b723-bd679a50d3a0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.122692] env[70006]: INFO networking_nsxv3.common.synchronization [None req-14c0abb6-cc95-4c0a-b5a5-c509c4614a71 None None] Enqueued Resource ID: a316f94d-da6c-431a-a316-d1fb6f006829 with Priority: HIGHEST for action port [ 697.122692] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a316f94d-da6c-431a-a316-d1fb6f006829 with Priority: HIGHEST for action port [ 697.122692] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-a316f94d-da6c-431a-a316-d1fb6f006829 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.122692] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a316f94d-da6c-431a-a316-d1fb6f006829" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.122692] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a316f94d-da6c-431a-a316-d1fb6f006829" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.122692] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a316f94d-da6c-431a-a316-d1fb6f006829" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.122692] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a316f94d-da6c-431a-a316-d1fb6f006829',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.228336] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a36672b1-ead4-4521-bd0d-2babb803d619 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.229146] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.246507] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a36672b1-ead4-4521-bd0d-2babb803d619',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.246853] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ecf33e4a-0e1b-41fe-b723-bd679a50d3a0 with status ACTIVE [ 697.247087] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.247525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.247525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.247525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.247649] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.247760] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.247856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.247918] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.248076] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.248151] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.248418] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.248555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.248595] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.248716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.248790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.248873] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ecf33e4a-0e1b-41fe-b723-bd679a50d3a0 is going to be updated. [ 697.279918] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.282637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.282637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.282637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.282637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.282637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecf33e4a-0e1b-41fe-b723-bd679a50d3a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.626856] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a316f94d-da6c-431a-a316-d1fb6f006829 [ 697.626856] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.626856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.626856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.626856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.626856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.626856] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a316f94d-da6c-431a-a316-d1fb6f006829 already deleted. [ 697.626856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a316f94d-da6c-431a-a316-d1fb6f006829" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.753379] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a36672b1-ead4-4521-bd0d-2babb803d619',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.255855] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.256128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.256128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.256378] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.256482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.256528] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a36672b1-ead4-4521-bd0d-2babb803d619 is going to be created. [ 698.288061] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.288289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.288341] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.288714] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.288714] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.299481] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a36672b1-ead4-4521-bd0d-2babb803d619 in Status: UNINITIALIZED for 2s [ 698.459424] env[70006]: INFO networking_nsxv3.common.synchronization [req-5b115d16-86a0-44bb-a64e-339516104152 req-60918834-c276-4b56-92f6-5fb847269770 tempest-DeleteServersAdminTestJSON-1843386794 tempest-DeleteServersAdminTestJSON-1843386794-project-member] Enqueued Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_members [ 698.459424] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_members [ 698.459424] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.459424] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.459424] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.459424] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.459424] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.459424] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.459424] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.459424] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.459424] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.459424] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.963537] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.963861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.963861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.964019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.964127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.964378] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.964490] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.964551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.965068] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.965068] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.965068] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 already deleted. [ 698.965068] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.057486] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.057486] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.057486] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.057730] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.060844] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.060844] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.060844] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.060844] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.060844] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.060844] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.060844] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.061504] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.061504] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.061504] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.061644] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.061930] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.083766] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.084206] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 699.084864] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.084864] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.085184] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-63c17eba-d2d2-44c2-bd66-bcbc6d27e157 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.085417] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-63c17eba-d2d2-44c2-bd66-bcbc6d27e157" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.085584] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-63c17eba-d2d2-44c2-bd66-bcbc6d27e157" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.085907] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-63c17eba-d2d2-44c2-bd66-bcbc6d27e157" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.086081] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63c17eba-d2d2-44c2-bd66-bcbc6d27e157',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.531413] env[70006]: INFO networking_nsxv3.common.synchronization [req-f5dd4d85-b39d-4fbd-8b3c-c22453db4ea4 req-2faf30a3-3f67-4fff-87b3-a981c459471e tempest-ImagesNegativeTestJSON-742815310 tempest-ImagesNegativeTestJSON-742815310-project-member] Enqueued Resource ID: 05505226-5645-4554-880f-d46c2bac7f8c with Priority: HIGHEST for action security_group_members [ 699.531413] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05505226-5645-4554-880f-d46c2bac7f8c with Priority: HIGHEST for action security_group_members [ 699.531485] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-05505226-5645-4554-880f-d46c2bac7f8c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.531671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.531717] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.531958] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.532466] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.532774] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.532774] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.532868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.532899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.532991] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05505226-5645-4554-880f-d46c2bac7f8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.588869] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.590318] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.590318] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.590318] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.590318] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.590318] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 63c17eba-d2d2-44c2-bd66-bcbc6d27e157 not found, creating... [ 699.591253] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.591253] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.591253] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.592227] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.592227] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.592432] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.592621] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.592621] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.592870] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.593032] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.593178] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 63c17eba-d2d2-44c2-bd66-bcbc6d27e157 is going to be created. [ 699.617886] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.619295] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.619406] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.619668] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.622157] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.622362] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-63c17eba-d2d2-44c2-bd66-bcbc6d27e157" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.910092] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-95 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.910436] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-95" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.910609] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-95" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.911556] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-95" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.911556] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.911556] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.911556] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.912011] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.912011] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.912011] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.912533] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.912533] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.912533] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.912656] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.913185] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.913185] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.932925] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.933140] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 699.933330] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.933455] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-95" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.933773] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-7edceb22-219c-4108-abc8-dabed5a1e064 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.934590] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-7edceb22-219c-4108-abc8-dabed5a1e064" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.934590] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-7edceb22-219c-4108-abc8-dabed5a1e064" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.934590] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-7edceb22-219c-4108-abc8-dabed5a1e064" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.934590] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7edceb22-219c-4108-abc8-dabed5a1e064',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.039722] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.040130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.040130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.040289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.040757] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.040757] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.040885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.040885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.041116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.041177] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.041239] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05505226-5645-4554-880f-d46c2bac7f8c already deleted. [ 700.041475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.279154] env[70006]: INFO networking_nsxv3.common.synchronization [None req-4a65e386-027e-492a-865c-da25e319f8c0 tempest-VolumesAdminNegativeTest-932475284 tempest-VolumesAdminNegativeTest-932475284-project-member] Enqueued Resource ID: 2695bb32-670b-49f4-b84e-274269e20fe5 with Priority: HIGHEST for action security_group_rules [ 700.280900] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2695bb32-670b-49f4-b84e-274269e20fe5 with Priority: HIGHEST for action security_group_rules [ 700.281304] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2695bb32-670b-49f4-b84e-274269e20fe5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.281441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.281523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.281860] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.282013] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2695bb32-670b-49f4-b84e-274269e20fe5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.311284] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a36672b1-ead4-4521-bd0d-2babb803d619 in Status: SUCCESS [ 700.311438] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.311613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.311833] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.312047] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.312169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.312234] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.312408] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.312479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.312568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.312655] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a36672b1-ead4-4521-bd0d-2babb803d619',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.438389] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.438389] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.438389] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.438585] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.438757] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.438948] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 7edceb22-219c-4108-abc8-dabed5a1e064 not found, creating... [ 700.439263] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.439516] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.439794] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.440036] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.440259] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.440650] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.440936] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.441078] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.441380] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.441560] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.441782] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 7edceb22-219c-4108-abc8-dabed5a1e064 is going to be created. [ 700.466578] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.466863] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.467045] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.467365] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.467654] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.467889] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-7edceb22-219c-4108-abc8-dabed5a1e064" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.685857] env[70006]: INFO networking_nsxv3.common.synchronization [None req-61ce3d4e-4443-4204-a6d9-22f2335b536b tempest-VolumesAdminNegativeTest-932475284 tempest-VolumesAdminNegativeTest-932475284-project-member] Enqueued Resource ID: 2695bb32-670b-49f4-b84e-274269e20fe5 with Priority: HIGHEST for action security_group_rules [ 700.686814] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2695bb32-670b-49f4-b84e-274269e20fe5 with Priority: HIGHEST for action security_group_rules [ 700.687629] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2695bb32-670b-49f4-b84e-274269e20fe5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.687739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.807219] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.807534] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.807534] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.807856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.807856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.807958] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2695bb32-670b-49f4-b84e-274269e20fe5 already deleted. [ 700.808025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.808205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.808578] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.808670] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2695bb32-670b-49f4-b84e-274269e20fe5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.814876] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a36672b1-ead4-4521-bd0d-2babb803d619 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.815878] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.815878] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.815878] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.815878] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.815878] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.815878] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.816898] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.816898] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.817206] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.817285] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a36672b1-ead4-4521-bd0d-2babb803d619 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.817684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.818066] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.818066] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.820541] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.820541] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.820541] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.820541] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.820541] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.820541] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.820541] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a36672b1-ead4-4521-bd0d-2babb803d619',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.983185] env[70006]: INFO networking_nsxv3.common.synchronization [req-5b115d16-86a0-44bb-a64e-339516104152 req-24f28e14-f107-4a3a-9cc2-593bc61949ce service nova] Enqueued Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_rules [ 700.983185] env[70006]: INFO networking_nsxv3.common.synchronization [req-5b115d16-86a0-44bb-a64e-339516104152 req-24f28e14-f107-4a3a-9cc2-593bc61949ce service nova] Enqueued Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_members [ 700.983185] env[70006]: INFO networking_nsxv3.common.synchronization [req-5b115d16-86a0-44bb-a64e-339516104152 req-24f28e14-f107-4a3a-9cc2-593bc61949ce service nova] Enqueued Resource ID: 63c17eba-d2d2-44c2-bd66-bcbc6d27e157 with Priority: HIGHEST for action port [ 700.983185] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_rules [ 700.983185] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_members [ 700.983185] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63c17eba-d2d2-44c2-bd66-bcbc6d27e157 with Priority: HIGHEST for action port [ 700.985864] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.985864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.985864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.986129] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.986866] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.987448] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.987548] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.987614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.987813] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.987951] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.988061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.988121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.988300] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.989224] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.989331] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.990284] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-63c17eba-d2d2-44c2-bd66-bcbc6d27e157 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.990396] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63c17eba-d2d2-44c2-bd66-bcbc6d27e157" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.990456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63c17eba-d2d2-44c2-bd66-bcbc6d27e157" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.990616] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63c17eba-d2d2-44c2-bd66-bcbc6d27e157" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.990812] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63c17eba-d2d2-44c2-bd66-bcbc6d27e157',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.324592] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a36672b1-ead4-4521-bd0d-2babb803d619: rpc.has_security_group_logging(os_id): False [ 701.345166] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.345166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.345166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.345166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.345166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.345166] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2695bb32-670b-49f4-b84e-274269e20fe5 already deleted. [ 701.345166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.349265] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.349871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.351319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.351319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.351319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.351319] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.351319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.351319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.351319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.355496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.355496] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.355496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.355496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.355496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.355496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.355496] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.355496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.355496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.355496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.355496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.355496] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a36672b1-ead4-4521-bd0d-2babb803d619 is going to be created. [ 701.428564] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.428714] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.428780] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.429026] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.429209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.446767] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a36672b1-ead4-4521-bd0d-2babb803d619 in Status: IN_PROGRESS for 2s [ 701.494937] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.495945] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.496108] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.496462] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63c17eba-d2d2-44c2-bd66-bcbc6d27e157 with status ACTIVE [ 701.496462] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.496602] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.496602] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.496835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.496934] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.497135] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.497846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.497846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.497846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.497846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.497846] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.498098] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.500684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.500684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.500684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.500684] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63c17eba-d2d2-44c2-bd66-bcbc6d27e157 is going to be updated. [ 701.550258] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.550537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.550537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.550771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.550908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.551161] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63c17eba-d2d2-44c2-bd66-bcbc6d27e157" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.845146] env[70006]: INFO networking_nsxv3.common.synchronization [req-f5dd4d85-b39d-4fbd-8b3c-c22453db4ea4 req-2dc2207f-1ab8-4a17-9832-9129695ad1f1 service nova] Enqueued Resource ID: 05505226-5645-4554-880f-d46c2bac7f8c with Priority: HIGHEST for action security_group_rules [ 701.845347] env[70006]: INFO networking_nsxv3.common.synchronization [req-f5dd4d85-b39d-4fbd-8b3c-c22453db4ea4 req-2dc2207f-1ab8-4a17-9832-9129695ad1f1 service nova] Enqueued Resource ID: 05505226-5645-4554-880f-d46c2bac7f8c with Priority: HIGHEST for action security_group_members [ 701.846498] env[70006]: INFO networking_nsxv3.common.synchronization [req-f5dd4d85-b39d-4fbd-8b3c-c22453db4ea4 req-2dc2207f-1ab8-4a17-9832-9129695ad1f1 service nova] Enqueued Resource ID: 7edceb22-219c-4108-abc8-dabed5a1e064 with Priority: HIGHEST for action port [ 701.847426] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05505226-5645-4554-880f-d46c2bac7f8c with Priority: HIGHEST for action security_group_rules [ 701.847426] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05505226-5645-4554-880f-d46c2bac7f8c with Priority: HIGHEST for action security_group_members [ 701.847426] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7edceb22-219c-4108-abc8-dabed5a1e064 with Priority: HIGHEST for action port [ 701.850242] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05505226-5645-4554-880f-d46c2bac7f8c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.850242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.850242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.850242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.850242] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05505226-5645-4554-880f-d46c2bac7f8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.850242] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-05505226-5645-4554-880f-d46c2bac7f8c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.851611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.851611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.851611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.852089] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.852089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.852089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.853115] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.853115] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.853115] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05505226-5645-4554-880f-d46c2bac7f8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.855950] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-7edceb22-219c-4108-abc8-dabed5a1e064 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.855950] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7edceb22-219c-4108-abc8-dabed5a1e064" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.855950] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7edceb22-219c-4108-abc8-dabed5a1e064" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.855950] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7edceb22-219c-4108-abc8-dabed5a1e064" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.855950] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7edceb22-219c-4108-abc8-dabed5a1e064',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.004350] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.361307] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7edceb22-219c-4108-abc8-dabed5a1e064 with status ACTIVE [ 702.361307] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.361667] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.361667] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.361667] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.361759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.361896] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.362080] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.362080] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.362212] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.362362] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.362467] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.362560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.362621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.362760] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.363157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.363157] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7edceb22-219c-4108-abc8-dabed5a1e064 is going to be updated. [ 702.366240] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05505226-5645-4554-880f-d46c2bac7f8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.367059] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-05505226-5645-4554-880f-d46c2bac7f8c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.367163] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.388233] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.388758] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.388758] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.388758] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.388967] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.389017] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7edceb22-219c-4108-abc8-dabed5a1e064" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.513029] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.513029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.513029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.513029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.513029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.513029] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 is going to be created. [ 702.558737] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.558907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.558962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.559791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.559791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.570632] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 in Status: UNINITIALIZED for 2s [ 702.719683] env[70006]: INFO networking_nsxv3.common.synchronization [None req-e058296c-0ebe-46c5-b349-61d822cce706 None None] Enqueued Resource ID: 1c653ecb-a9da-4acf-9f17-ad2919db8193 with Priority: HIGHEST for action port [ 702.719683] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c653ecb-a9da-4acf-9f17-ad2919db8193 with Priority: HIGHEST for action port [ 702.719683] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c653ecb-a9da-4acf-9f17-ad2919db8193 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.719683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c653ecb-a9da-4acf-9f17-ad2919db8193" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.719683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c653ecb-a9da-4acf-9f17-ad2919db8193" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.719683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c653ecb-a9da-4acf-9f17-ad2919db8193" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.719683] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c653ecb-a9da-4acf-9f17-ad2919db8193',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.865383] env[70006]: INFO networking_nsxv3.common.synchronization [req-3f668bbd-39cb-4f0c-aaa9-1c6f16b4b12a req-e0b91e63-5d6a-4b64-bf55-6e5a1023e32f tempest-ServerAddressesNegativeTestJSON-943476673 tempest-ServerAddressesNegativeTestJSON-943476673-project-member] Enqueued Resource ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 with Priority: HIGHEST for action security_group_members [ 702.865949] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 with Priority: HIGHEST for action security_group_members [ 702.866880] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.868315] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.868501] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.868842] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.869144] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.869383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.869426] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.870257] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.870290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.870517] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed4cc3e0-52bb-498d-9f73-56ded2b5d090',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.871989] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05505226-5645-4554-880f-d46c2bac7f8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.047050] env[70006]: INFO networking_nsxv3.common.synchronization [None req-66521146-7756-4ce7-8706-f3786aa9a755 None None] Enqueued Resource ID: 04346ffd-9fe4-4454-a87c-26320169676d with Priority: HIGHEST for action port [ 703.047050] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04346ffd-9fe4-4454-a87c-26320169676d with Priority: HIGHEST for action port [ 703.047050] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-04346ffd-9fe4-4454-a87c-26320169676d taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.054207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04346ffd-9fe4-4454-a87c-26320169676d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.054207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04346ffd-9fe4-4454-a87c-26320169676d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.054207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04346ffd-9fe4-4454-a87c-26320169676d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.054207] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04346ffd-9fe4-4454-a87c-26320169676d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.223039] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c653ecb-a9da-4acf-9f17-ad2919db8193 [ 703.223857] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.223857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.223857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.223857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.224320] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.224320] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c653ecb-a9da-4acf-9f17-ad2919db8193 already deleted. [ 703.224412] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c653ecb-a9da-4acf-9f17-ad2919db8193" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.376317] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.377115] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.377450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.377821] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.380234] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.380481] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.380662] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.380747] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.380989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.381136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.381343] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 already deleted. [ 703.381419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.381778] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.381988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.381988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.382329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.382416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.382535] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05505226-5645-4554-880f-d46c2bac7f8c is going to be created. [ 703.428565] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.428769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.428812] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.429031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.429225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.444181] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05505226-5645-4554-880f-d46c2bac7f8c in Status: UNINITIALIZED for 2s [ 703.467061] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a36672b1-ead4-4521-bd0d-2babb803d619 in Status: SUCCESS [ 703.467383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.489987] env[70006]: INFO networking_nsxv3.common.synchronization [None req-c4bc539c-0b41-4d31-b900-d8f1e73a3ea9 None None] Enqueued Resource ID: 967dcc00-694c-4d2c-b9a3-dc2cb2a88db9 with Priority: HIGHEST for action port [ 703.489987] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 967dcc00-694c-4d2c-b9a3-dc2cb2a88db9 with Priority: HIGHEST for action port [ 703.489987] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-967dcc00-694c-4d2c-b9a3-dc2cb2a88db9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.489987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-967dcc00-694c-4d2c-b9a3-dc2cb2a88db9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.493313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-967dcc00-694c-4d2c-b9a3-dc2cb2a88db9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.495120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-967dcc00-694c-4d2c-b9a3-dc2cb2a88db9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.495120] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('967dcc00-694c-4d2c-b9a3-dc2cb2a88db9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.556190] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04346ffd-9fe4-4454-a87c-26320169676d [ 703.556190] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.556190] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.556190] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.556190] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.556190] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.556190] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04346ffd-9fe4-4454-a87c-26320169676d already deleted. [ 703.556190] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04346ffd-9fe4-4454-a87c-26320169676d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.914154] env[70006]: INFO networking_nsxv3.common.synchronization [None req-d96bd25a-de47-40c4-b00d-73db2870f4b0 None None] Enqueued Resource ID: ec8059a4-dd27-4885-b977-f59428347060 with Priority: HIGHEST for action port [ 703.915564] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec8059a4-dd27-4885-b977-f59428347060 with Priority: HIGHEST for action port [ 703.916691] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec8059a4-dd27-4885-b977-f59428347060 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.916691] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec8059a4-dd27-4885-b977-f59428347060" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.916691] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec8059a4-dd27-4885-b977-f59428347060" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.917510] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec8059a4-dd27-4885-b977-f59428347060" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.917510] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec8059a4-dd27-4885-b977-f59428347060',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.947411] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-288 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.948097] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-288" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.948097] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-288" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.948097] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-288" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.948747] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.948747] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.948747] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.949642] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.949642] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.949642] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.949642] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.949642] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.949642] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.949847] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.953554] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.953554] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.977016] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.977016] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 703.977016] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.977016] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-288" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.977016] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-21a0b03c-bc07-44c7-b9e4-503338c106cd taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.977016] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-21a0b03c-bc07-44c7-b9e4-503338c106cd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.977016] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-21a0b03c-bc07-44c7-b9e4-503338c106cd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.977016] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-21a0b03c-bc07-44c7-b9e4-503338c106cd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.977016] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21a0b03c-bc07-44c7-b9e4-503338c106cd',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.001460] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 967dcc00-694c-4d2c-b9a3-dc2cb2a88db9 [ 704.002416] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.002416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.002416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.002416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.002416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.002416] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:967dcc00-694c-4d2c-b9a3-dc2cb2a88db9 already deleted. [ 704.002416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-967dcc00-694c-4d2c-b9a3-dc2cb2a88db9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.003623] env[70006]: INFO networking_nsxv3.common.synchronization [None req-17fafdec-38f5-42e3-a922-123b94bdadab tempest-VolumesAssistedSnapshotsTest-275775559 tempest-VolumesAssistedSnapshotsTest-275775559-project-member] Enqueued Resource ID: 2d0a478f-3de2-453c-980b-25efdb42c355 with Priority: HIGHEST for action security_group_rules [ 704.004371] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d0a478f-3de2-453c-980b-25efdb42c355 with Priority: HIGHEST for action security_group_rules [ 704.004682] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d0a478f-3de2-453c-980b-25efdb42c355 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.004792] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.004864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.005132] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.005215] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d0a478f-3de2-453c-980b-25efdb42c355',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.224900] env[70006]: INFO networking_nsxv3.common.synchronization [None req-51e023a7-c637-4ab2-a628-4fa49162fa50 None None] Enqueued Resource ID: b0eae64b-6875-4d7f-b51b-e5c48ba703aa with Priority: HIGHEST for action port [ 704.225338] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0eae64b-6875-4d7f-b51b-e5c48ba703aa with Priority: HIGHEST for action port [ 704.225784] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0eae64b-6875-4d7f-b51b-e5c48ba703aa taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.227081] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0eae64b-6875-4d7f-b51b-e5c48ba703aa" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.227081] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0eae64b-6875-4d7f-b51b-e5c48ba703aa" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.230753] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0eae64b-6875-4d7f-b51b-e5c48ba703aa" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.230898] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0eae64b-6875-4d7f-b51b-e5c48ba703aa',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.387340] env[70006]: INFO networking_nsxv3.common.synchronization [None req-cb7c8a1e-e712-456e-805d-a23b2a24753f tempest-VolumesAssistedSnapshotsTest-275775559 tempest-VolumesAssistedSnapshotsTest-275775559-project-member] Enqueued Resource ID: 2d0a478f-3de2-453c-980b-25efdb42c355 with Priority: HIGHEST for action security_group_rules [ 704.388745] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d0a478f-3de2-453c-980b-25efdb42c355 with Priority: HIGHEST for action security_group_rules [ 704.389896] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d0a478f-3de2-453c-980b-25efdb42c355 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.389896] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.421393] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec8059a4-dd27-4885-b977-f59428347060 [ 704.421622] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.421788] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.421859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.422104] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.422193] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.422290] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec8059a4-dd27-4885-b977-f59428347060 already deleted. [ 704.422363] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec8059a4-dd27-4885-b977-f59428347060" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.479209] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.479466] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.479754] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.480144] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.480840] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.480840] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 21a0b03c-bc07-44c7-b9e4-503338c106cd not found, creating... [ 704.481328] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.482170] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.482170] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.482577] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.483176] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.483759] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.485228] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.485228] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.485228] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.485228] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.485228] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 21a0b03c-bc07-44c7-b9e4-503338c106cd is going to be created. [ 704.506138] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.506369] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.506546] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.506828] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.507100] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.507359] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-21a0b03c-bc07-44c7-b9e4-503338c106cd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.538870] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.539482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.539546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.539780] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.539890] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.540072] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d0a478f-3de2-453c-980b-25efdb42c355 already deleted. [ 704.540178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.540355] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.540567] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.541075] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d0a478f-3de2-453c-980b-25efdb42c355',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.594487] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 in Status: SUCCESS [ 704.595158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.595158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.595158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.595380] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.596297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.596297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.596297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.596297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.596297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.596297] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.658167] env[70006]: INFO networking_nsxv3.common.synchronization [None req-35ba8e26-3b95-4942-96dd-131964a86f29 None None] Enqueued Resource ID: 0af4b0c7-e9a2-489a-a48f-97dffa9b3878 with Priority: HIGHEST for action port [ 704.658489] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0af4b0c7-e9a2-489a-a48f-97dffa9b3878 with Priority: HIGHEST for action port [ 704.659056] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-0af4b0c7-e9a2-489a-a48f-97dffa9b3878 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.659168] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0af4b0c7-e9a2-489a-a48f-97dffa9b3878" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.659241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0af4b0c7-e9a2-489a-a48f-97dffa9b3878" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.659516] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0af4b0c7-e9a2-489a-a48f-97dffa9b3878" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.659595] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0af4b0c7-e9a2-489a-a48f-97dffa9b3878',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.733177] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0eae64b-6875-4d7f-b51b-e5c48ba703aa [ 704.737077] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.737077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.737077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.737077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.737077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.737077] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0eae64b-6875-4d7f-b51b-e5c48ba703aa already deleted. [ 704.737077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0eae64b-6875-4d7f-b51b-e5c48ba703aa" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.045032] env[70006]: INFO networking_nsxv3.common.synchronization [req-c84fc8da-e6b7-48e6-ad27-76a91cd08613 req-6fae41ae-2cdd-4bdf-b826-c24e2c41065c tempest-MigrationsAdminTest-838255870 tempest-MigrationsAdminTest-838255870-project-member] Enqueued Resource ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 with Priority: HIGHEST for action security_group_members [ 705.046068] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 with Priority: HIGHEST for action security_group_members [ 705.046464] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f885e47a-f0d6-416e-9871-7d36cac6dbc6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.046599] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.047296] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.047296] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.047416] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.047486] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.047834] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.047906] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.047960] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.048116] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f885e47a-f0d6-416e-9871-7d36cac6dbc6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.074773] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.074773] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.074773] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.074773] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.074773] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.074773] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d0a478f-3de2-453c-980b-25efdb42c355 already deleted. [ 705.074773] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.104076] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.104373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.104452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.104727] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.104986] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.105176] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.105234] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.105413] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.105568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.105634] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.106135] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.106135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.106135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.106432] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.106432] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.106529] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.106529] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.107868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.107868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.107868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.107868] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.163661] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0af4b0c7-e9a2-489a-a48f-97dffa9b3878 [ 705.163922] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.164086] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.164158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.164498] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.164498] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.164619] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0af4b0c7-e9a2-489a-a48f-97dffa9b3878 already deleted. [ 705.164667] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0af4b0c7-e9a2-489a-a48f-97dffa9b3878" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.264172] env[70006]: INFO networking_nsxv3.common.synchronization [None req-df1ffb9a-fd68-4356-884b-685d57ebb71b None None] Enqueued Resource ID: eb766960-8e31-4e28-a2a9-89344cdbfea6 with Priority: HIGHEST for action port [ 705.265291] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb766960-8e31-4e28-a2a9-89344cdbfea6 with Priority: HIGHEST for action port [ 705.266497] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb766960-8e31-4e28-a2a9-89344cdbfea6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.266817] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb766960-8e31-4e28-a2a9-89344cdbfea6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.267136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb766960-8e31-4e28-a2a9-89344cdbfea6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.268819] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb766960-8e31-4e28-a2a9-89344cdbfea6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.268819] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb766960-8e31-4e28-a2a9-89344cdbfea6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.457887] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05505226-5645-4554-880f-d46c2bac7f8c in Status: SUCCESS [ 705.457887] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.458227] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.458227] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.458622] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.458622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.458840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.458840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.458977] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.459057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.459127] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05505226-5645-4554-880f-d46c2bac7f8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.554765] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.554765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.554765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.554765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.555729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.555999] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.556148] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.556212] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.557037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.557037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.557037] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 already deleted. [ 705.557037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.611431] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98: rpc.has_security_group_logging(os_id): False [ 705.635059] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.635233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.635275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.635530] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.635684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.635967] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.636097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.636219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.636494] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.636576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.636842] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.636955] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.638210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.638569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.638686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.639131] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.639197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.639261] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.639592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.639804] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.639896] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 is going to be created. [ 705.686054] env[70006]: INFO networking_nsxv3.common.synchronization [None req-d65aa67a-311c-4243-bc94-227f230b567d None None] Enqueued Resource ID: 8ae90bcd-ca32-4bd6-b805-7dfdfe4004f8 with Priority: HIGHEST for action port [ 705.686054] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae90bcd-ca32-4bd6-b805-7dfdfe4004f8 with Priority: HIGHEST for action port [ 705.686054] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ae90bcd-ca32-4bd6-b805-7dfdfe4004f8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.686054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ae90bcd-ca32-4bd6-b805-7dfdfe4004f8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.686054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ae90bcd-ca32-4bd6-b805-7dfdfe4004f8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.686054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ae90bcd-ca32-4bd6-b805-7dfdfe4004f8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.686054] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ae90bcd-ca32-4bd6-b805-7dfdfe4004f8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.710834] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.710991] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.712153] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.712153] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.712153] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.712153] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.712413] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.712523] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.712745] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.712982] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.713157] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.713308] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.713461] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.713608] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.713745] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.713902] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.731413] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.731614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.731660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.731843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.732042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.744362] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.744519] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 705.744656] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.744833] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.745154] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-b402fce4-7392-4139-8de5-7620820e0814 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.745342] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-b402fce4-7392-4139-8de5-7620820e0814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.745461] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-b402fce4-7392-4139-8de5-7620820e0814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.745815] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-b402fce4-7392-4139-8de5-7620820e0814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.745950] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b402fce4-7392-4139-8de5-7620820e0814',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.749665] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 in Status: IN_PROGRESS for 2s [ 705.772275] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb766960-8e31-4e28-a2a9-89344cdbfea6 [ 705.772275] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.772275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.772275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.772275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.772275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.772275] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb766960-8e31-4e28-a2a9-89344cdbfea6 already deleted. [ 705.772275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb766960-8e31-4e28-a2a9-89344cdbfea6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.961700] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-05505226-5645-4554-880f-d46c2bac7f8c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.961885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.961940] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.962209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.964112] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.964811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.964811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.964811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.964811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.964811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.964996] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-05505226-5645-4554-880f-d46c2bac7f8c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.965050] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.965085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.965240] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.965385] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.965478] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.965539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.965677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.965756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.965838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.965929] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05505226-5645-4554-880f-d46c2bac7f8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.188135] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ae90bcd-ca32-4bd6-b805-7dfdfe4004f8 [ 706.188483] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.188627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.188699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.188931] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.189032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.189127] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ae90bcd-ca32-4bd6-b805-7dfdfe4004f8 already deleted. [ 706.189212] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ae90bcd-ca32-4bd6-b805-7dfdfe4004f8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.251776] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.252056] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.252056] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.252291] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.253137] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.253137] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port b402fce4-7392-4139-8de5-7620820e0814 not found, creating... [ 706.253137] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.253137] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.253583] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.253583] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.253583] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.255429] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.255429] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.255671] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.255886] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.256110] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.257938] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: b402fce4-7392-4139-8de5-7620820e0814 is going to be created. [ 706.282759] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.282994] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.283149] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.283972] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.283972] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.283972] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-b402fce4-7392-4139-8de5-7620820e0814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.374023] env[70006]: INFO networking_nsxv3.common.synchronization [req-3f668bbd-39cb-4f0c-aaa9-1c6f16b4b12a req-d267dcee-dd83-4a40-ab50-d244cbe6ff59 service nova] Enqueued Resource ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 with Priority: HIGHEST for action security_group_rules [ 706.374023] env[70006]: INFO networking_nsxv3.common.synchronization [req-3f668bbd-39cb-4f0c-aaa9-1c6f16b4b12a req-d267dcee-dd83-4a40-ab50-d244cbe6ff59 service nova] Enqueued Resource ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 with Priority: HIGHEST for action security_group_members [ 706.374023] env[70006]: INFO networking_nsxv3.common.synchronization [req-3f668bbd-39cb-4f0c-aaa9-1c6f16b4b12a req-d267dcee-dd83-4a40-ab50-d244cbe6ff59 service nova] Enqueued Resource ID: 21a0b03c-bc07-44c7-b9e4-503338c106cd with Priority: HIGHEST for action port [ 706.374023] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 with Priority: HIGHEST for action security_group_rules [ 706.374023] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 with Priority: HIGHEST for action security_group_members [ 706.374023] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a0b03c-bc07-44c7-b9e4-503338c106cd with Priority: HIGHEST for action port [ 706.375773] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed4cc3e0-52bb-498d-9f73-56ded2b5d090 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.376456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.376820] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.377346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.377590] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed4cc3e0-52bb-498d-9f73-56ded2b5d090',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.379176] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.383074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.383074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.383074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.383074] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.383074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.383074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.383074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.383074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.383074] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed4cc3e0-52bb-498d-9f73-56ded2b5d090',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.383074] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-21a0b03c-bc07-44c7-b9e4-503338c106cd taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.383074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21a0b03c-bc07-44c7-b9e4-503338c106cd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.383074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21a0b03c-bc07-44c7-b9e4-503338c106cd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.383074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21a0b03c-bc07-44c7-b9e4-503338c106cd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.383074] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21a0b03c-bc07-44c7-b9e4-503338c106cd',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.469534] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05505226-5645-4554-880f-d46c2bac7f8c: rpc.has_security_group_logging(os_id): False [ 706.491394] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.491394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.491394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.491394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.491394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.491632] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.491798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.491798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.491976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.492031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.492236] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.492323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.492381] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.492515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.492591] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.492781] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.492867] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.492951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.495316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.495736] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.495801] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05505226-5645-4554-880f-d46c2bac7f8c is going to be created. [ 706.562710] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.562925] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.563058] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.563714] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.563891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.579255] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05505226-5645-4554-880f-d46c2bac7f8c in Status: IN_PROGRESS for 2s [ 706.889715] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.889854] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.890056] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed4cc3e0-52bb-498d-9f73-56ded2b5d090',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.891090] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21a0b03c-bc07-44c7-b9e4-503338c106cd with status ACTIVE [ 706.891309] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.891309] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.891527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.891527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.893806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.894151] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.894472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.894951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.895377] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.895489] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.895943] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.895943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.897377] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.899796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.899796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.899796] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21a0b03c-bc07-44c7-b9e4-503338c106cd is going to be updated. [ 706.924496] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.926042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.926042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.926042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.926042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.926490] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21a0b03c-bc07-44c7-b9e4-503338c106cd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.302852] env[70006]: INFO networking_nsxv3.common.synchronization [req-c84fc8da-e6b7-48e6-ad27-76a91cd08613 req-65a8703c-3da0-4eed-9c58-d6fb1a216d3f service nova] Enqueued Resource ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 with Priority: HIGHEST for action security_group_rules [ 707.303049] env[70006]: INFO networking_nsxv3.common.synchronization [req-c84fc8da-e6b7-48e6-ad27-76a91cd08613 req-65a8703c-3da0-4eed-9c58-d6fb1a216d3f service nova] Enqueued Resource ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 with Priority: HIGHEST for action security_group_members [ 707.307024] env[70006]: INFO networking_nsxv3.common.synchronization [req-c84fc8da-e6b7-48e6-ad27-76a91cd08613 req-65a8703c-3da0-4eed-9c58-d6fb1a216d3f service nova] Enqueued Resource ID: b402fce4-7392-4139-8de5-7620820e0814 with Priority: HIGHEST for action port [ 707.307024] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 with Priority: HIGHEST for action security_group_rules [ 707.307024] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 with Priority: HIGHEST for action security_group_members [ 707.307024] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b402fce4-7392-4139-8de5-7620820e0814 with Priority: HIGHEST for action port [ 707.307024] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f885e47a-f0d6-416e-9871-7d36cac6dbc6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.307024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.307024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.307024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.307024] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f885e47a-f0d6-416e-9871-7d36cac6dbc6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.307024] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f885e47a-f0d6-416e-9871-7d36cac6dbc6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.307024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.307024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.307024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.307024] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.307024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.307024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.307024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.307024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.307024] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f885e47a-f0d6-416e-9871-7d36cac6dbc6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.308486] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-b402fce4-7392-4139-8de5-7620820e0814 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.308486] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b402fce4-7392-4139-8de5-7620820e0814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.308486] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b402fce4-7392-4139-8de5-7620820e0814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.308486] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b402fce4-7392-4139-8de5-7620820e0814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.308486] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b402fce4-7392-4139-8de5-7620820e0814',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.400484] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed4cc3e0-52bb-498d-9f73-56ded2b5d090',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.766927] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 in Status: SUCCESS [ 707.767256] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.809821] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f885e47a-f0d6-416e-9871-7d36cac6dbc6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.814219] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f885e47a-f0d6-416e-9871-7d36cac6dbc6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.814219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.814219] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b402fce4-7392-4139-8de5-7620820e0814 with status ACTIVE [ 707.814219] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.814219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.814219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.814219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.814219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.814219] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.814219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.814219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.814219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.814219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.816138] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.816408] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.816568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.816863] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.817407] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.817604] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b402fce4-7392-4139-8de5-7620820e0814 is going to be updated. [ 707.841848] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.841848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.841848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.841848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.841848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.841848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b402fce4-7392-4139-8de5-7620820e0814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.903151] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.903316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.903391] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.903610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.903704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.903805] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 is going to be created. [ 707.956540] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.956791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.956791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.956970] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.957144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.972106] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 in Status: UNINITIALIZED for 2s [ 708.142119] env[70006]: INFO networking_nsxv3.common.synchronization [req-b8a3ac39-f38e-49dd-8060-ec950b00747e req-e7a6667e-31a0-4fd0-bf37-a9eaf33d1edb tempest-InstanceActionsV221TestJSON-840280228 tempest-InstanceActionsV221TestJSON-840280228-project-member] Enqueued Resource ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 with Priority: HIGHEST for action security_group_members [ 708.143022] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 with Priority: HIGHEST for action security_group_members [ 708.143547] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d10f346-7e60-4bf9-a322-b64cbffea871 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.143547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.143719] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.144768] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.145451] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.145451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.145451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.145451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.145451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.145818] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d10f346-7e60-4bf9-a322-b64cbffea871',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.312421] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f885e47a-f0d6-416e-9871-7d36cac6dbc6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.602361] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05505226-5645-4554-880f-d46c2bac7f8c in Status: SUCCESS [ 708.602361] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.648316] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.648542] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.648614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.648909] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.648999] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.649208] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.649327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.649388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.649556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.649637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.649748] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 already deleted. [ 708.649857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.814843] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.815343] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.815343] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.815343] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.815490] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.815535] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 is going to be created. [ 708.840310] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.840639] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.840639] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.841081] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.841081] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.853298] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 in Status: UNINITIALIZED for 2s [ 709.289587] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.290058] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-119" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.291832] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-119" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.291832] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-119" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.292167] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.293260] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.293260] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.293570] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.293623] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.298276] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.298276] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.298276] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.298276] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.298276] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.298276] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.298276] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.326051] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.326051] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 709.326051] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.326051] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-119" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.326051] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-c9bdfb0a-f6f0-4467-b641-a8c04598910f taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.326051] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-c9bdfb0a-f6f0-4467-b641-a8c04598910f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.326051] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-c9bdfb0a-f6f0-4467-b641-a8c04598910f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.327883] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-c9bdfb0a-f6f0-4467-b641-a8c04598910f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.328192] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9bdfb0a-f6f0-4467-b641-a8c04598910f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.621725] env[70006]: INFO networking_nsxv3.common.synchronization [None req-9da9450e-1fe9-4a7d-aaed-30016cf173c6 None None] Enqueued Resource ID: 6ab3450d-3b7f-4c0a-be2c-02737ae0473f with Priority: HIGHEST for action port [ 709.621725] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab3450d-3b7f-4c0a-be2c-02737ae0473f with Priority: HIGHEST for action port [ 709.622280] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ab3450d-3b7f-4c0a-be2c-02737ae0473f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.622280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ab3450d-3b7f-4c0a-be2c-02737ae0473f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.622280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ab3450d-3b7f-4c0a-be2c-02737ae0473f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.622627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ab3450d-3b7f-4c0a-be2c-02737ae0473f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.622627] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ab3450d-3b7f-4c0a-be2c-02737ae0473f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.835500] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.835500] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.835500] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.835500] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.835500] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.835500] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port c9bdfb0a-f6f0-4467-b641-a8c04598910f not found, creating... [ 709.835500] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.835500] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.835500] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.835500] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.835500] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.836068] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.836068] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.836068] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.837981] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.837981] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.837981] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: c9bdfb0a-f6f0-4467-b641-a8c04598910f is going to be created. [ 709.862498] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.862622] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.862732] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.863014] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.863284] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.863540] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-c9bdfb0a-f6f0-4467-b641-a8c04598910f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.983391] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 in Status: SUCCESS [ 709.983988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.984397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.985280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.985494] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.985622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.985765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.985876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.985955] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.986042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.986114] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed4cc3e0-52bb-498d-9f73-56ded2b5d090',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.126573] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ab3450d-3b7f-4c0a-be2c-02737ae0473f [ 710.126824] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.126960] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.127048] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.128486] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.128486] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.128486] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ab3450d-3b7f-4c0a-be2c-02737ae0473f already deleted. [ 710.128486] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ab3450d-3b7f-4c0a-be2c-02737ae0473f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.235977] env[70006]: INFO networking_nsxv3.common.synchronization [None req-3d681be1-a378-4173-8f8b-4847d55add51 None None] Enqueued Resource ID: 61f9626b-32aa-4510-a7f1-dfba445dfc4e with Priority: HIGHEST for action port [ 710.237255] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61f9626b-32aa-4510-a7f1-dfba445dfc4e with Priority: HIGHEST for action port [ 710.238038] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-61f9626b-32aa-4510-a7f1-dfba445dfc4e taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.238138] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61f9626b-32aa-4510-a7f1-dfba445dfc4e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.238204] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61f9626b-32aa-4510-a7f1-dfba445dfc4e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.238528] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61f9626b-32aa-4510-a7f1-dfba445dfc4e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.238913] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61f9626b-32aa-4510-a7f1-dfba445dfc4e',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.490162] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.490357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.490438] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.490694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.490864] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.490944] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.490980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.491146] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.491236] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.491325] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.491511] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.491632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.491721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.491873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.492060] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.492149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.492195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.492313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.492391] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.492475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.492567] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed4cc3e0-52bb-498d-9f73-56ded2b5d090',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.744552] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61f9626b-32aa-4510-a7f1-dfba445dfc4e [ 710.744859] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.745018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.745113] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.745380] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.745483] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.745587] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61f9626b-32aa-4510-a7f1-dfba445dfc4e already deleted. [ 710.745675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61f9626b-32aa-4510-a7f1-dfba445dfc4e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.868367] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 in Status: SUCCESS [ 710.872021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.872021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.872021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.872021] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.872021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.872021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.872021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.872021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.872021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.872021] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f885e47a-f0d6-416e-9871-7d36cac6dbc6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.996671] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed4cc3e0-52bb-498d-9f73-56ded2b5d090: rpc.has_security_group_logging(os_id): False [ 711.019599] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.019810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.019864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.020163] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.021986] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.022257] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.024370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.024370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.024370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.024370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.024370] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.024370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.024370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.024370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.024641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.024768] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.025172] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.025292] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.025514] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.025617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.025718] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 is going to be created. [ 711.073587] env[70006]: INFO networking_nsxv3.common.synchronization [req-b8a3ac39-f38e-49dd-8060-ec950b00747e req-3eb3dc72-8c3d-488b-b7c5-d54ca0fb7e6a service nova] Enqueued Resource ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 with Priority: HIGHEST for action security_group_rules [ 711.073587] env[70006]: INFO networking_nsxv3.common.synchronization [req-b8a3ac39-f38e-49dd-8060-ec950b00747e req-3eb3dc72-8c3d-488b-b7c5-d54ca0fb7e6a service nova] Enqueued Resource ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 with Priority: HIGHEST for action security_group_members [ 711.073587] env[70006]: INFO networking_nsxv3.common.synchronization [req-b8a3ac39-f38e-49dd-8060-ec950b00747e req-3eb3dc72-8c3d-488b-b7c5-d54ca0fb7e6a service nova] Enqueued Resource ID: c9bdfb0a-f6f0-4467-b641-a8c04598910f with Priority: HIGHEST for action port [ 711.073587] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 with Priority: HIGHEST for action security_group_rules [ 711.073587] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 with Priority: HIGHEST for action security_group_members [ 711.073587] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9bdfb0a-f6f0-4467-b641-a8c04598910f with Priority: HIGHEST for action port [ 711.073587] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d10f346-7e60-4bf9-a322-b64cbffea871 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.073587] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.073587] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.073973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.073973] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d10f346-7e60-4bf9-a322-b64cbffea871',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.076360] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d10f346-7e60-4bf9-a322-b64cbffea871 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.076360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.076360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.076360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.076683] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.076683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.076683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.076858] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.076858] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.077234] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d10f346-7e60-4bf9-a322-b64cbffea871',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.077844] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9bdfb0a-f6f0-4467-b641-a8c04598910f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.078085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9bdfb0a-f6f0-4467-b641-a8c04598910f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.078085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9bdfb0a-f6f0-4467-b641-a8c04598910f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.079537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9bdfb0a-f6f0-4467-b641-a8c04598910f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.079537] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9bdfb0a-f6f0-4467-b641-a8c04598910f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.101155] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.101345] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.101426] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.101850] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.101936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.120935] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 in Status: IN_PROGRESS for 2s [ 711.377978] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f885e47a-f0d6-416e-9871-7d36cac6dbc6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.378249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.378289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.378905] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.379031] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.379100] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.379181] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.379347] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.379451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.379580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.379775] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f885e47a-f0d6-416e-9871-7d36cac6dbc6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.379900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.379971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.380174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.385216] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.385216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.385216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.385216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.385216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.385216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.385216] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f885e47a-f0d6-416e-9871-7d36cac6dbc6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.509308] env[70006]: INFO networking_nsxv3.common.synchronization [None req-c26a4937-9b81-44f4-8223-5ef08cd984c4 None None] Enqueued Resource ID: b875933e-503d-4e93-b36d-ba833a6ed016 with Priority: HIGHEST for action port [ 711.512656] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b875933e-503d-4e93-b36d-ba833a6ed016 with Priority: HIGHEST for action port [ 711.512656] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-b875933e-503d-4e93-b36d-ba833a6ed016 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.512656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b875933e-503d-4e93-b36d-ba833a6ed016" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.512656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b875933e-503d-4e93-b36d-ba833a6ed016" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.514211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b875933e-503d-4e93-b36d-ba833a6ed016" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.514211] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b875933e-503d-4e93-b36d-ba833a6ed016',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.581552] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d10f346-7e60-4bf9-a322-b64cbffea871 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.581715] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.581964] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9bdfb0a-f6f0-4467-b641-a8c04598910f with status ACTIVE [ 711.582113] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.582394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.582394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.582566] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.582687] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.582874] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.582965] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.583042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.583216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.583425] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.583516] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.583571] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.583605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.583605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.583605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.583605] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9bdfb0a-f6f0-4467-b641-a8c04598910f is going to be updated. [ 711.586780] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d10f346-7e60-4bf9-a322-b64cbffea871',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.625781] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.626400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.626637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.627810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.627810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.627810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9bdfb0a-f6f0-4467-b641-a8c04598910f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.889514] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f885e47a-f0d6-416e-9871-7d36cac6dbc6: rpc.has_security_group_logging(os_id): False [ 711.909275] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.909496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.909548] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.909803] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.910387] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.910387] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.910387] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.910387] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.910630] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.910630] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.910849] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.910849] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.910964] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.911080] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.911174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.911452] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.911658] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.911658] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.911735] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.911769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.911835] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 is going to be created. [ 711.973886] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.974028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.975092] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.975092] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.975092] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.988812] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 in Status: IN_PROGRESS for 2s [ 712.018498] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b875933e-503d-4e93-b36d-ba833a6ed016 [ 712.019156] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.019156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.019156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.019434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.019434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.019577] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b875933e-503d-4e93-b36d-ba833a6ed016 already deleted. [ 712.019629] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b875933e-503d-4e93-b36d-ba833a6ed016" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.089748] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d10f346-7e60-4bf9-a322-b64cbffea871',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.454962] env[70006]: INFO networking_nsxv3.common.synchronization [req-852c9458-355b-49b9-ad95-9b07529624b4 req-23a04601-576f-49b2-828d-aaf4f46ab0a0 tempest-ServerActionsTestJSON-71305913 tempest-ServerActionsTestJSON-71305913-project-member] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 712.456056] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 712.456164] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.457671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.457671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.457671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.457671] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.457671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.457671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.457671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.457671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.458257] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.592289] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.592289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.592289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.592643] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.592643] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.592643] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 is going to be created. [ 712.625306] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.625306] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.625490] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.625697] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.625796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.642803] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 in Status: UNINITIALIZED for 2s [ 712.840996] env[70006]: INFO networking_nsxv3.common.synchronization [None req-7da369d2-a97a-4278-bf9e-3d594ee119fe tempest-ServersWithSpecificFlavorTestJSON-1233962006 tempest-ServersWithSpecificFlavorTestJSON-1233962006-project-member] Enqueued Resource ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 with Priority: HIGHEST for action security_group_rules [ 712.842862] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 with Priority: HIGHEST for action security_group_rules [ 712.843381] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.843720] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.843993] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.844379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.844580] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('caa33f7e-8d3a-4a22-985b-0a592f9b03a1',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.881450] env[70006]: INFO networking_nsxv3.common.synchronization [None req-e809c225-c326-4a03-9122-e5c5f461678e None None] Enqueued Resource ID: d3ca01a2-2663-4a04-ae35-623829b29fcd with Priority: HIGHEST for action port [ 712.881450] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3ca01a2-2663-4a04-ae35-623829b29fcd with Priority: HIGHEST for action port [ 712.881450] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3ca01a2-2663-4a04-ae35-623829b29fcd taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.882984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3ca01a2-2663-4a04-ae35-623829b29fcd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.882984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3ca01a2-2663-4a04-ae35-623829b29fcd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.882984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3ca01a2-2663-4a04-ae35-623829b29fcd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.882984] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3ca01a2-2663-4a04-ae35-623829b29fcd',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.945891] env[70006]: INFO networking_nsxv3.common.synchronization [None req-7fd5f876-c73c-4d75-ae70-de3a8db0c947 tempest-ServersWithSpecificFlavorTestJSON-1233962006 tempest-ServersWithSpecificFlavorTestJSON-1233962006-project-member] Enqueued Resource ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 with Priority: HIGHEST for action security_group_rules [ 712.946504] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 with Priority: HIGHEST for action security_group_rules [ 712.947278] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.947278] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.960321] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.960492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.960557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.960952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.960952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.961084] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.961142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.961481] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.961481] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.961481] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.961612] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c already deleted. [ 712.961641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.138012] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 in Status: SUCCESS [ 713.138690] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.203364] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-405 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.203364] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.203364] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.203364] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.203364] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.203364] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.203364] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.203364] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.204788] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.205505] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.205505] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.205505] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.208133] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.208133] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.208133] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.208133] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.232282] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.232455] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.233494] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.233739] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.234290] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-a0d11944-d177-42a5-ad2b-22c116396f8a taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.234512] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-a0d11944-d177-42a5-ad2b-22c116396f8a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.234832] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-a0d11944-d177-42a5-ad2b-22c116396f8a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.235053] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-a0d11944-d177-42a5-ad2b-22c116396f8a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.235299] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0d11944-d177-42a5-ad2b-22c116396f8a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.369744] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.369744] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.370015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.370120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.370184] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.370346] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 already deleted. [ 713.370406] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.370552] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.370734] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.370856] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('caa33f7e-8d3a-4a22-985b-0a592f9b03a1',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.387759] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3ca01a2-2663-4a04-ae35-623829b29fcd [ 713.387759] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.387759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.387759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.387927] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.387927] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.387994] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3ca01a2-2663-4a04-ae35-623829b29fcd already deleted. [ 713.388770] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3ca01a2-2663-4a04-ae35-623829b29fcd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.738342] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.738621] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.738781] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.739142] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.739341] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.739538] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port a0d11944-d177-42a5-ad2b-22c116396f8a not found, creating... [ 713.739825] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.739992] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.740127] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.740393] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.740549] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.740851] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.741020] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.741619] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.743385] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.743556] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.743713] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: a0d11944-d177-42a5-ad2b-22c116396f8a is going to be created. [ 713.771794] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.772041] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.772178] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.772491] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.773857] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.773857] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-a0d11944-d177-42a5-ad2b-22c116396f8a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.895824] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.896024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.896072] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.896279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.896416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.896517] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 already deleted. [ 713.896603] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.005797] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 in Status: SUCCESS [ 714.006105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.319668] env[70006]: INFO networking_nsxv3.common.synchronization [req-f636c5ef-bc35-4af5-b60c-e389e731f3af req-cbc1d800-9824-4777-b796-c2f383d159ed tempest-DeleteServersAdminTestJSON-2063474761 tempest-DeleteServersAdminTestJSON-2063474761-project-admin] Enqueued Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_members [ 714.321024] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_members [ 714.321024] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.321169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.321206] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.321419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.321576] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.321678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.321994] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.321994] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.321994] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.322138] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.509713] env[70006]: INFO networking_nsxv3.common.synchronization [req-b40fa478-c5de-4929-b9bb-c402080e34a9 req-d37dc20b-c636-46c5-aef3-7f83e5476316 tempest-ServerDiagnosticsTest-1436260678 tempest-ServerDiagnosticsTest-1436260678-project-member] Enqueued Resource ID: a36672b1-ead4-4521-bd0d-2babb803d619 with Priority: HIGHEST for action security_group_members [ 714.510289] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a36672b1-ead4-4521-bd0d-2babb803d619 with Priority: HIGHEST for action security_group_members [ 714.510600] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a36672b1-ead4-4521-bd0d-2babb803d619 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.514243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.514243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.514418] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.514595] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.514706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.514769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.514920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.515063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.515105] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a36672b1-ead4-4521-bd0d-2babb803d619',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.651051] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 in Status: SUCCESS [ 714.651051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.651051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.651161] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.651290] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.651583] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.651583] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.651761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.651761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.651818] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.651875] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d10f346-7e60-4bf9-a322-b64cbffea871',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.826549] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.826720] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.826720] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.827028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.827028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.827889] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.827889] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.827889] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.827889] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.827889] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.827889] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 is going to be updated. [ 714.882687] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.883242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.883242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.883468] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.884028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.897213] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 in Status: IN_PROGRESS for 2s [ 714.995419] env[70006]: INFO networking_nsxv3.common.synchronization [req-8c11520b-c679-40f7-baa7-c68d13316c0d req-7d48578d-e464-4b1e-a3ef-08a93c9991cd tempest-AttachInterfacesV270Test-841799969 tempest-AttachInterfacesV270Test-841799969-project-member] Enqueued Resource ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc with Priority: HIGHEST for action security_group_members [ 714.996031] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc with Priority: HIGHEST for action security_group_members [ 714.997735] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.997892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.997948] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.001183] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.001183] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.001183] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.001183] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.001183] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.001529] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.001529] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.017222] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.017501] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.017501] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.017671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.017768] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.018195] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.018195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.018195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.018349] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.018349] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.018507] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a36672b1-ead4-4521-bd0d-2babb803d619 is going to be updated. [ 715.055616] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.056951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.056951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.056951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.056951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.068984] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a36672b1-ead4-4521-bd0d-2babb803d619 in Status: IN_PROGRESS for 2s [ 715.101778] env[70006]: INFO networking_nsxv3.common.synchronization [req-852c9458-355b-49b9-ad95-9b07529624b4 req-2137a5d8-b98a-4d64-b2fe-2b482f367439 service nova] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_rules [ 715.101778] env[70006]: INFO networking_nsxv3.common.synchronization [req-852c9458-355b-49b9-ad95-9b07529624b4 req-2137a5d8-b98a-4d64-b2fe-2b482f367439 service nova] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 715.101952] env[70006]: INFO networking_nsxv3.common.synchronization [req-852c9458-355b-49b9-ad95-9b07529624b4 req-2137a5d8-b98a-4d64-b2fe-2b482f367439 service nova] Enqueued Resource ID: a0d11944-d177-42a5-ad2b-22c116396f8a with Priority: HIGHEST for action port [ 715.103439] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_rules [ 715.103439] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 715.103439] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0d11944-d177-42a5-ad2b-22c116396f8a with Priority: HIGHEST for action port [ 715.103439] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.103439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.103439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.103852] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.103852] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.104489] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.104669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.104669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.105853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.105853] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.105853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.105853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.105853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.105853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.105853] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.106335] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0d11944-d177-42a5-ad2b-22c116396f8a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.106474] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0d11944-d177-42a5-ad2b-22c116396f8a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.106537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0d11944-d177-42a5-ad2b-22c116396f8a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.107039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0d11944-d177-42a5-ad2b-22c116396f8a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.107039] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0d11944-d177-42a5-ad2b-22c116396f8a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.155835] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d10f346-7e60-4bf9-a322-b64cbffea871 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.155835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.155835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.155988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.156056] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.156159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.156224] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.156619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.156768] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.156871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.157038] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d10f346-7e60-4bf9-a322-b64cbffea871 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.157941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.157941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.157941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.157941] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.157941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.157941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.157941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.157941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.157941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.158480] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d10f346-7e60-4bf9-a322-b64cbffea871',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.505747] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.506185] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.508869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.508869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.508869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.508869] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.508869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.508869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.508869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.508869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.508869] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc already deleted. [ 715.508869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.536106] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-79 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.536440] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.536639] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.537029] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.537381] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.537586] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.537716] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.538210] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.538210] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.538433] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.538807] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.538807] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.538807] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.538967] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.539137] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.539310] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.569431] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.569431] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 715.569640] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.569840] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.570185] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-aa55189e-9d4e-4fc1-9143-9b0ade9887b7 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.570381] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-aa55189e-9d4e-4fc1-9143-9b0ade9887b7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.570547] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-aa55189e-9d4e-4fc1-9143-9b0ade9887b7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.570980] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-aa55189e-9d4e-4fc1-9143-9b0ade9887b7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.571167] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa55189e-9d4e-4fc1-9143-9b0ade9887b7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.609206] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.609353] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.609952] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.611193] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0d11944-d177-42a5-ad2b-22c116396f8a with status ACTIVE [ 715.611394] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.611567] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.611641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.612159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.612159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.612159] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.612338] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.612338] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.612430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.612779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.612779] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.612779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.612945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.612945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.613016] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.613159] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0d11944-d177-42a5-ad2b-22c116396f8a is going to be updated. [ 715.651699] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.651906] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.652352] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.652659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.652855] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.653138] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0d11944-d177-42a5-ad2b-22c116396f8a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.660235] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d10f346-7e60-4bf9-a322-b64cbffea871: rpc.has_security_group_logging(os_id): False [ 715.681014] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.681180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.681254] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.681469] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.681563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.681754] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.681841] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.681907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.682119] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.682243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.682394] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.682481] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.682545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.682767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.682953] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.683623] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.683623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.683623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.683623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.683623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.683851] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 is going to be created. [ 715.782969] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.782969] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.782969] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.782969] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.782969] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.797206] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 in Status: IN_PROGRESS for 2s [ 716.081315] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.081315] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.081315] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.081315] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.081315] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.081315] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port aa55189e-9d4e-4fc1-9143-9b0ade9887b7 not found, creating... [ 716.081315] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.081315] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.081315] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.081315] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.081315] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.081903] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.081903] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.081903] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.081903] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.081903] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.081903] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: aa55189e-9d4e-4fc1-9143-9b0ade9887b7 is going to be created. [ 716.109021] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.109021] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.109021] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.109021] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.109021] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.109021] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-aa55189e-9d4e-4fc1-9143-9b0ade9887b7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.117447] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.621650] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.621887] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.621887] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.622078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.622182] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.622348] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c is going to be created. [ 716.649944] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.650597] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.650597] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.650769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.650845] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.665259] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: UNINITIALIZED for 2s [ 716.907574] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 in Status: SUCCESS [ 716.907758] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 deletion is rescheduled due to dependency. [ 716.907871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.080268] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a36672b1-ead4-4521-bd0d-2babb803d619 in Status: SUCCESS [ 717.080268] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a36672b1-ead4-4521-bd0d-2babb803d619 deletion is rescheduled due to dependency. [ 717.080268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.210075] env[70006]: INFO networking_nsxv3.common.synchronization [req-001cad16-da0e-4381-8e31-0d436f866fba req-cf85e47d-a450-40ed-ac8a-c386e1c7128f tempest-ImagesNegativeTestJSON-742815310 tempest-ImagesNegativeTestJSON-742815310-project-member] Enqueued Resource ID: 05505226-5645-4554-880f-d46c2bac7f8c with Priority: HIGHEST for action security_group_members [ 717.211036] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05505226-5645-4554-880f-d46c2bac7f8c with Priority: HIGHEST for action security_group_members [ 717.211036] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-05505226-5645-4554-880f-d46c2bac7f8c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.211775] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.211775] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.211775] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.211969] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.212123] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.212218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.212419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.212549] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.212723] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05505226-5645-4554-880f-d46c2bac7f8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.470439] env[70006]: INFO networking_nsxv3.common.synchronization [req-ab08cefb-030a-48b3-9894-df96e47252f0 req-e7936a75-7571-4b2e-bb70-c45948936728 tempest-ImagesTestJSON-196229908 tempest-ImagesTestJSON-196229908-project-member] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 717.470439] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 717.470439] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.470439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.470439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.470439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.470439] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.470439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.470439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.470439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.470439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.470439] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.563154] env[70006]: INFO networking_nsxv3.common.synchronization [req-8c11520b-c679-40f7-baa7-c68d13316c0d req-bf119bf8-9a4e-44dd-a70f-faa7a0b62134 service nova] Enqueued Resource ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc with Priority: HIGHEST for action security_group_rules [ 717.563343] env[70006]: INFO networking_nsxv3.common.synchronization [req-8c11520b-c679-40f7-baa7-c68d13316c0d req-bf119bf8-9a4e-44dd-a70f-faa7a0b62134 service nova] Enqueued Resource ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc with Priority: HIGHEST for action security_group_members [ 717.563506] env[70006]: INFO networking_nsxv3.common.synchronization [req-8c11520b-c679-40f7-baa7-c68d13316c0d req-bf119bf8-9a4e-44dd-a70f-faa7a0b62134 service nova] Enqueued Resource ID: aa55189e-9d4e-4fc1-9143-9b0ade9887b7 with Priority: HIGHEST for action port [ 717.563981] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc with Priority: HIGHEST for action security_group_rules [ 717.565607] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc with Priority: HIGHEST for action security_group_members [ 717.565607] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa55189e-9d4e-4fc1-9143-9b0ade9887b7 with Priority: HIGHEST for action port [ 717.566300] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.567284] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.567415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.567711] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.567829] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.569358] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.569555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.569654] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.569935] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.570069] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.570207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.570281] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.570823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.570975] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.571129] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.573248] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa55189e-9d4e-4fc1-9143-9b0ade9887b7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.573395] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa55189e-9d4e-4fc1-9143-9b0ade9887b7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.573482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa55189e-9d4e-4fc1-9143-9b0ade9887b7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.573672] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa55189e-9d4e-4fc1-9143-9b0ade9887b7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.575756] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa55189e-9d4e-4fc1-9143-9b0ade9887b7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.822245] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.822245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.822245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.822245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.822245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.822245] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.822245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.822245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.822245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.822245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.822245] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05505226-5645-4554-880f-d46c2bac7f8c is going to be updated. [ 717.822245] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.822245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.822245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.822245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.822245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.830133] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05505226-5645-4554-880f-d46c2bac7f8c in Status: IN_PROGRESS for 2s [ 717.830133] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 in Status: SUCCESS [ 717.830133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.973017] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.973488] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.973721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.974134] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.974425] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.974736] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.975098] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.975316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.977941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.977941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.977941] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 already deleted. [ 717.977941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.078032] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.080580] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.080580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.080580] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa55189e-9d4e-4fc1-9143-9b0ade9887b7 with status ACTIVE [ 718.080580] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.080580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.080580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.080580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.080580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.080580] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.080580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.081166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.081166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.081166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.082630] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.082630] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.082630] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.082630] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.082630] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.082630] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa55189e-9d4e-4fc1-9143-9b0ade9887b7 is going to be updated. [ 718.110052] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.110314] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.110380] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.110756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.110911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.111064] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa55189e-9d4e-4fc1-9143-9b0ade9887b7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.269137] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.269618] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.269618] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.270019] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.270952] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.271847] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.271847] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.271847] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.272198] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.272198] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.272363] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.272441] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.272558] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.272714] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.272825] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.273835] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.302451] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.302639] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 718.302798] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.302985] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.303352] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-a4ff3dbe-e842-4e4a-939e-e3f429ebad04 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.303543] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-a4ff3dbe-e842-4e4a-939e-e3f429ebad04" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.303682] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-a4ff3dbe-e842-4e4a-939e-e3f429ebad04" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.304048] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-a4ff3dbe-e842-4e4a-939e-e3f429ebad04" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.304212] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4ff3dbe-e842-4e4a-939e-e3f429ebad04',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.585527] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.679605] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: SUCCESS [ 718.679605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.679605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.679605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.679605] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.679605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.679605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.679605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.679605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.679605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.679605] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.807877] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.808098] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.808231] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.808548] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.808701] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.808855] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port a4ff3dbe-e842-4e4a-939e-e3f429ebad04 not found, creating... [ 718.809205] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.809281] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.809460] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.809648] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.809852] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.810289] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.810475] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.810771] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.811030] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.811337] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.811495] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: a4ff3dbe-e842-4e4a-939e-e3f429ebad04 is going to be created. [ 718.836430] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.838041] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.839351] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.840268] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.842749] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.842749] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-a4ff3dbe-e842-4e4a-939e-e3f429ebad04" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.089112] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.089112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.089112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.089305] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.089335] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.089445] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc is going to be created. [ 719.118440] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.118440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.118440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.118440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.118440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.132894] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc in Status: UNINITIALIZED for 2s [ 719.182954] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.359409] env[70006]: INFO networking_nsxv3.common.synchronization [req-2c99fbc0-e6b2-4597-9010-729571ab2059 req-4ec8ba74-d4b4-442d-a632-009bf6cf6ba4 tempest-ServerDiagnosticsNegativeTest-1600725784 tempest-ServerDiagnosticsNegativeTest-1600725784-project-member] Enqueued Resource ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 with Priority: HIGHEST for action security_group_members [ 719.359950] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 with Priority: HIGHEST for action security_group_members [ 719.360605] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.360605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.360605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.360874] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.360874] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.360976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.361047] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.361439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.361439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.361439] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('946a4bb3-35a7-45bf-b93f-0879f8e48ab0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.478300] env[70006]: INFO networking_nsxv3.common.synchronization [None req-9ccdd3e2-2878-4c61-84f6-12492c07d5e9 None None] Enqueued Resource ID: 019c9d82-e671-4848-8eee-e354c1c57edc with Priority: HIGHEST for action port [ 719.478629] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 019c9d82-e671-4848-8eee-e354c1c57edc with Priority: HIGHEST for action port [ 719.479492] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-019c9d82-e671-4848-8eee-e354c1c57edc taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.479602] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-019c9d82-e671-4848-8eee-e354c1c57edc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.479708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-019c9d82-e671-4848-8eee-e354c1c57edc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.481393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-019c9d82-e671-4848-8eee-e354c1c57edc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.481393] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('019c9d82-e671-4848-8eee-e354c1c57edc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.690414] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28b8ed16-99b8-40b6-8095-2254b0cf928c: rpc.has_security_group_logging(os_id): False [ 719.714899] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.715106] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.716314] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.718316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.718433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.719077] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.719077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.719077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.719275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.719275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.719330] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c is going to be created. [ 719.783373] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05505226-5645-4554-880f-d46c2bac7f8c in Status: SUCCESS [ 719.783674] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05505226-5645-4554-880f-d46c2bac7f8c deletion is rescheduled due to dependency. [ 719.783824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.809999] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.812925] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.813045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.813296] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.813456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.819204] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.819204] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.819204] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.819204] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.819204] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.819204] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.819204] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.819204] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.819204] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.819641] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.819641] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.819641] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.819741] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.819934] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.819934] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.820177] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.857251] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: IN_PROGRESS for 2s [ 719.860510] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.860769] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 719.860911] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.861151] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.861501] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-9a809fa3-d1c4-4bff-b415-a9845cbdc5ad taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.861685] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-9a809fa3-d1c4-4bff-b415-a9845cbdc5ad" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.861912] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-9a809fa3-d1c4-4bff-b415-a9845cbdc5ad" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.862363] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-9a809fa3-d1c4-4bff-b415-a9845cbdc5ad" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.862563] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a809fa3-d1c4-4bff-b415-a9845cbdc5ad',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.863612] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.863735] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.863808] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.864056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.864112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.864760] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.864900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.864960] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.865777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.865777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.865777] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 already deleted. [ 719.865777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.912198] env[70006]: INFO networking_nsxv3.common.synchronization [req-ab08cefb-030a-48b3-9894-df96e47252f0 req-617798cc-887e-4b7a-bc34-6caf9a023f6d service nova] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_rules [ 719.912678] env[70006]: INFO networking_nsxv3.common.synchronization [req-ab08cefb-030a-48b3-9894-df96e47252f0 req-617798cc-887e-4b7a-bc34-6caf9a023f6d service nova] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 719.912960] env[70006]: INFO networking_nsxv3.common.synchronization [req-ab08cefb-030a-48b3-9894-df96e47252f0 req-617798cc-887e-4b7a-bc34-6caf9a023f6d service nova] Enqueued Resource ID: a4ff3dbe-e842-4e4a-939e-e3f429ebad04 with Priority: HIGHEST for action port [ 719.913894] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_rules [ 719.913894] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 719.913894] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4ff3dbe-e842-4e4a-939e-e3f429ebad04 with Priority: HIGHEST for action port [ 719.914704] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.914860] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.914957] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.915371] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.915406] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.916596] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.920024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.920024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.920024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.920024] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.920024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.920024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.920024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.920024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.920024] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.920564] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4ff3dbe-e842-4e4a-939e-e3f429ebad04 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.920564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4ff3dbe-e842-4e4a-939e-e3f429ebad04" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.920564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4ff3dbe-e842-4e4a-939e-e3f429ebad04" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.920714] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4ff3dbe-e842-4e4a-939e-e3f429ebad04" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.920714] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4ff3dbe-e842-4e4a-939e-e3f429ebad04',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.983626] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 019c9d82-e671-4848-8eee-e354c1c57edc [ 719.983890] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.984010] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.984087] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.984315] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.984399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.984513] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:019c9d82-e671-4848-8eee-e354c1c57edc already deleted. [ 719.984577] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-019c9d82-e671-4848-8eee-e354c1c57edc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.367670] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.368047] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.368047] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.369076] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.369076] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.369076] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 9a809fa3-d1c4-4bff-b415-a9845cbdc5ad not found, creating... [ 720.369273] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.370195] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.370195] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.370195] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.370195] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.370851] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.371191] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.371358] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.371631] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.371875] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.371946] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 9a809fa3-d1c4-4bff-b415-a9845cbdc5ad is going to be created. [ 720.399026] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.399026] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.399026] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.399026] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.399026] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.399026] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-9a809fa3-d1c4-4bff-b415-a9845cbdc5ad" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.423088] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.425179] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.425179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.425179] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4ff3dbe-e842-4e4a-939e-e3f429ebad04 with status ACTIVE [ 720.425179] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.425179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.425744] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.425744] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.425971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.426219] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.426317] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.426443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.426701] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.426798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.427065] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.431343] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.431343] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.431343] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.431343] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.431343] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4ff3dbe-e842-4e4a-939e-e3f429ebad04 is going to be updated. [ 720.457377] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.457782] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.457782] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.458597] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.458775] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.458934] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4ff3dbe-e842-4e4a-939e-e3f429ebad04" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.932580] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.090524] env[70006]: INFO networking_nsxv3.common.synchronization [req-2c99fbc0-e6b2-4597-9010-729571ab2059 req-5589cda8-25df-4969-9a04-8866e0fecf65 service nova] Enqueued Resource ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 with Priority: HIGHEST for action security_group_rules [ 721.090524] env[70006]: INFO networking_nsxv3.common.synchronization [req-2c99fbc0-e6b2-4597-9010-729571ab2059 req-5589cda8-25df-4969-9a04-8866e0fecf65 service nova] Enqueued Resource ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 with Priority: HIGHEST for action security_group_members [ 721.090524] env[70006]: INFO networking_nsxv3.common.synchronization [req-2c99fbc0-e6b2-4597-9010-729571ab2059 req-5589cda8-25df-4969-9a04-8866e0fecf65 service nova] Enqueued Resource ID: 9a809fa3-d1c4-4bff-b415-a9845cbdc5ad with Priority: HIGHEST for action port [ 721.090524] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 with Priority: HIGHEST for action security_group_rules [ 721.090524] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 with Priority: HIGHEST for action security_group_members [ 721.090524] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a809fa3-d1c4-4bff-b415-a9845cbdc5ad with Priority: HIGHEST for action port [ 721.090524] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-946a4bb3-35a7-45bf-b93f-0879f8e48ab0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.090866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.091091] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.091530] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.094370] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('946a4bb3-35a7-45bf-b93f-0879f8e48ab0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.094370] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.094370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.094370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.094370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.094370] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.094370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.094370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.094370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.094370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.094370] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('946a4bb3-35a7-45bf-b93f-0879f8e48ab0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.096389] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a809fa3-d1c4-4bff-b415-a9845cbdc5ad taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.096640] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a809fa3-d1c4-4bff-b415-a9845cbdc5ad" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.096640] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a809fa3-d1c4-4bff-b415-a9845cbdc5ad" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.096907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a809fa3-d1c4-4bff-b415-a9845cbdc5ad" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.096981] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a809fa3-d1c4-4bff-b415-a9845cbdc5ad',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.145308] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc in Status: UNINITIALIZED for 4s [ 721.437417] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.437989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.437989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.438258] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.438258] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.438357] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be created. [ 721.469571] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.469671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.470239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.470239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.470239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.487599] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: UNINITIALIZED for 2s [ 721.599573] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('946a4bb3-35a7-45bf-b93f-0879f8e48ab0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.601217] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.601333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.601503] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a809fa3-d1c4-4bff-b415-a9845cbdc5ad with status ACTIVE [ 721.601671] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.601779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.601843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.602448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.602618] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.602811] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.602914] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.602992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.603194] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.603396] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.603762] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.603866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.603929] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.605285] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.605285] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.605285] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a809fa3-d1c4-4bff-b415-a9845cbdc5ad is going to be updated. [ 721.637245] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.637442] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.637525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.637755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.637901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.638084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a809fa3-d1c4-4bff-b415-a9845cbdc5ad" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.870649] env[70006]: INFO networking_nsxv3.common.synchronization [None req-f0a8c244-f879-44aa-9b42-4f046ea1c476 None None] Enqueued Resource ID: 9bdb8c8c-528e-49f5-99c1-e12f9c85feb9 with Priority: HIGHEST for action port [ 721.875406] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: SUCCESS [ 721.875406] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.875914] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bdb8c8c-528e-49f5-99c1-e12f9c85feb9 with Priority: HIGHEST for action port [ 721.876087] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bdb8c8c-528e-49f5-99c1-e12f9c85feb9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.876209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bdb8c8c-528e-49f5-99c1-e12f9c85feb9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.876276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bdb8c8c-528e-49f5-99c1-e12f9c85feb9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.876523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bdb8c8c-528e-49f5-99c1-e12f9c85feb9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.876607] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bdb8c8c-528e-49f5-99c1-e12f9c85feb9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.108022] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('946a4bb3-35a7-45bf-b93f-0879f8e48ab0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.162091] env[70006]: INFO networking_nsxv3.common.synchronization [req-c472705b-a661-4ae6-a77a-91d8a504d402 req-26cb098e-f926-486c-af25-a943a375742e tempest-VolumesAdminNegativeTest-932475284 tempest-VolumesAdminNegativeTest-932475284-project-member] Enqueued Resource ID: 2695bb32-670b-49f4-b84e-274269e20fe5 with Priority: HIGHEST for action security_group_members [ 722.165168] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2695bb32-670b-49f4-b84e-274269e20fe5 with Priority: HIGHEST for action security_group_members [ 722.165168] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-2695bb32-670b-49f4-b84e-274269e20fe5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.165168] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.165168] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.165797] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.166141] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.166415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.166656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.166993] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.167266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.168330] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2695bb32-670b-49f4-b84e-274269e20fe5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.381396] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9bdb8c8c-528e-49f5-99c1-e12f9c85feb9 [ 722.382049] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.382625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.382899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.383497] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.383777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.383997] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9bdb8c8c-528e-49f5-99c1-e12f9c85feb9 already deleted. [ 722.384243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bdb8c8c-528e-49f5-99c1-e12f9c85feb9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.608986] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.609310] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.609310] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.609478] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.609549] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.609646] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 is going to be created. [ 722.637450] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.637450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.637574] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.639066] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.639066] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.651740] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 in Status: UNINITIALIZED for 2s [ 722.664105] env[70006]: INFO networking_nsxv3.common.synchronization [None req-41f603cf-e76f-43ac-ba55-2f20a3e8731f tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: cefeff63-e154-425d-8ffe-56cc092db146 with Priority: HIGHEST for action security_group_rules [ 722.665620] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cefeff63-e154-425d-8ffe-56cc092db146 with Priority: HIGHEST for action security_group_rules [ 722.665620] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cefeff63-e154-425d-8ffe-56cc092db146 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.667375] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.667375] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.668034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.668127] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cefeff63-e154-425d-8ffe-56cc092db146',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.669604] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.669725] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.669791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.669970] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.670069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.670251] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.670344] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.670403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.670552] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.670619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.671652] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2695bb32-670b-49f4-b84e-274269e20fe5 already deleted. [ 722.671652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.894051] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.895124] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-34" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.895355] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-34" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.895746] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-34" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.896069] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.896242] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.896369] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.896645] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.896823] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.897071] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.897192] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.897299] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.897430] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.897523] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.897623] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.897784] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.908201] env[70006]: INFO networking_nsxv3.common.synchronization [None req-275f517b-7e66-4ff7-8071-6744f83744a3 tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: cefeff63-e154-425d-8ffe-56cc092db146 with Priority: HIGHEST for action security_group_rules [ 722.909227] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cefeff63-e154-425d-8ffe-56cc092db146 with Priority: HIGHEST for action security_group_rules [ 722.909565] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cefeff63-e154-425d-8ffe-56cc092db146 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.909683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.920351] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.920564] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 722.920736] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.920931] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-34" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.921346] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-0da6d475-040d-43e8-9139-88652285a5fe taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.921625] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-0da6d475-040d-43e8-9139-88652285a5fe" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.921764] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-0da6d475-040d-43e8-9139-88652285a5fe" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.922113] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-0da6d475-040d-43e8-9139-88652285a5fe" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.922403] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0da6d475-040d-43e8-9139-88652285a5fe',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.967709] env[70006]: INFO networking_nsxv3.common.synchronization [req-4fa7e70c-f994-4864-8036-1ea70c1ff9f2 req-e9c680fb-594f-416b-819d-c1a77f44440a tempest-ServerAddressesNegativeTestJSON-943476673 tempest-ServerAddressesNegativeTestJSON-943476673-project-member] Enqueued Resource ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 with Priority: HIGHEST for action security_group_members [ 722.967709] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 with Priority: HIGHEST for action security_group_members [ 722.968146] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.968629] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.968867] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.969245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.970185] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.970949] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.970949] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.972824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.972824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.972824] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed4cc3e0-52bb-498d-9f73-56ded2b5d090',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.158909] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc in Status: SUCCESS [ 723.159382] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.161104] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.161104] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.161104] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.161104] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.161104] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.162514] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.162667] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.162807] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.162935] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.194870] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.195616] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.195616] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.196997] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.196997] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.196997] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cefeff63-e154-425d-8ffe-56cc092db146 already deleted. [ 723.197118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.200212] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.200212] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.200212] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cefeff63-e154-425d-8ffe-56cc092db146',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.427701] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.430548] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.430548] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.430548] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.430548] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.431966] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 0da6d475-040d-43e8-9139-88652285a5fe not found, creating... [ 723.431966] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.431966] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.431966] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.432345] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.432848] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.433305] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.434169] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.434169] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.434539] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.435051] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.435051] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 0da6d475-040d-43e8-9139-88652285a5fe is going to be created. [ 723.463830] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.463830] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.464066] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.464640] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.464640] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.464846] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-0da6d475-040d-43e8-9139-88652285a5fe" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.476359] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.476359] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.476359] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.476590] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.479102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.479102] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.479102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.479102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.479102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.479102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.479102] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 is going to be updated. [ 723.501037] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 723.501037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.501260] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.501370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.501578] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.501750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.501825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.502043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.502136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.502229] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.502327] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.517026] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.517192] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.517263] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.517490] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.517636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.533872] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 in Status: IN_PROGRESS for 2s [ 723.670489] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.670993] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.670993] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.671387] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.671584] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.671712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.671755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.671953] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.672268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.672429] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.672939] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.672939] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.672939] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.673135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.673222] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.673269] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.673340] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.673520] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.673597] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.673691] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.673921] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.723506] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.723506] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.723506] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.723945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.723945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.723945] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cefeff63-e154-425d-8ffe-56cc092db146 already deleted. [ 723.724208] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.009033] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.009033] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.009033] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.009324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.009737] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.009737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.009737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.009936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.009972] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.010108] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.010275] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.010380] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.010447] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.010648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.010823] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.011026] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.011026] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.011383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.011383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.011383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.011515] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.179780] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc: rpc.has_security_group_logging(os_id): False [ 724.203711] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.203926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.203998] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.204237] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.204327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.204580] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.204685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.205336] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.205336] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.205336] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.205336] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.205336] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.205560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.205560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.205616] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.205752] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.205847] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.205930] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.206189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.206231] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.206311] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc is going to be created. [ 724.276649] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.276799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.276799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.277239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.277239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.293928] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc in Status: IN_PROGRESS for 2s [ 724.316025] env[70006]: INFO networking_nsxv3.common.synchronization [None req-58ac8863-6ef5-4617-82e6-98f56901318e None None] Enqueued Resource ID: 37e4c9f7-4c15-46b7-8520-a708671742a7 with Priority: HIGHEST for action port [ 724.316025] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37e4c9f7-4c15-46b7-8520-a708671742a7 with Priority: HIGHEST for action port [ 724.316025] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-37e4c9f7-4c15-46b7-8520-a708671742a7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.316025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37e4c9f7-4c15-46b7-8520-a708671742a7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.316025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37e4c9f7-4c15-46b7-8520-a708671742a7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.316025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37e4c9f7-4c15-46b7-8520-a708671742a7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.316025] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37e4c9f7-4c15-46b7-8520-a708671742a7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.514896] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46e7bb0e-3b0b-455c-8638-3cb59c191bf9: rpc.has_security_group_logging(os_id): False [ 724.543928] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.543928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.543928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.543928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.543928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.543928] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.543928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.543928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.543928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.543928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.543928] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.543928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.543928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.543928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.543928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.544657] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.544657] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.544657] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.544657] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.544657] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.544657] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be created. [ 724.616178] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.616357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.616425] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.616653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.616837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.633335] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: IN_PROGRESS for 2s [ 724.667243] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 in Status: SUCCESS [ 724.668440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.668440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.668440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.668676] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.668850] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.672354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.672354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.672354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.672354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.672354] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('946a4bb3-35a7-45bf-b93f-0879f8e48ab0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.820487] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37e4c9f7-4c15-46b7-8520-a708671742a7 [ 724.820732] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.820930] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.820998] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.821802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.821802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.821802] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37e4c9f7-4c15-46b7-8520-a708671742a7 already deleted. [ 724.821802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37e4c9f7-4c15-46b7-8520-a708671742a7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.922428] env[70006]: INFO networking_nsxv3.common.synchronization [req-c472705b-a661-4ae6-a77a-91d8a504d402 req-10780d21-a823-4eca-8f88-b4c7a1178c05 service nova] Enqueued Resource ID: 2695bb32-670b-49f4-b84e-274269e20fe5 with Priority: HIGHEST for action security_group_rules [ 724.922501] env[70006]: INFO networking_nsxv3.common.synchronization [req-c472705b-a661-4ae6-a77a-91d8a504d402 req-10780d21-a823-4eca-8f88-b4c7a1178c05 service nova] Enqueued Resource ID: 2695bb32-670b-49f4-b84e-274269e20fe5 with Priority: HIGHEST for action security_group_members [ 724.922656] env[70006]: INFO networking_nsxv3.common.synchronization [req-c472705b-a661-4ae6-a77a-91d8a504d402 req-10780d21-a823-4eca-8f88-b4c7a1178c05 service nova] Enqueued Resource ID: 0da6d475-040d-43e8-9139-88652285a5fe with Priority: HIGHEST for action port [ 724.924225] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2695bb32-670b-49f4-b84e-274269e20fe5 with Priority: HIGHEST for action security_group_rules [ 724.924393] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2695bb32-670b-49f4-b84e-274269e20fe5 with Priority: HIGHEST for action security_group_members [ 724.924493] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0da6d475-040d-43e8-9139-88652285a5fe with Priority: HIGHEST for action port [ 724.924876] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2695bb32-670b-49f4-b84e-274269e20fe5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.924944] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.925027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.925250] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.925328] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2695bb32-670b-49f4-b84e-274269e20fe5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.928346] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-2695bb32-670b-49f4-b84e-274269e20fe5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.928346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.928346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.928346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.928346] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.928346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.928346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.928774] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.928955] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.929137] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2695bb32-670b-49f4-b84e-274269e20fe5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.930309] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-0da6d475-040d-43e8-9139-88652285a5fe taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.930892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0da6d475-040d-43e8-9139-88652285a5fe" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.931088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0da6d475-040d-43e8-9139-88652285a5fe" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.931376] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0da6d475-040d-43e8-9139-88652285a5fe" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.931512] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0da6d475-040d-43e8-9139-88652285a5fe',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.174036] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.174206] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.174206] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.174371] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.174556] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.174646] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.174737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.174855] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.174963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.175057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.176135] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.176430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.176532] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.180118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.180118] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.180118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.180118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.180118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.180118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.180118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.180118] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('946a4bb3-35a7-45bf-b93f-0879f8e48ab0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.433919] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2695bb32-670b-49f4-b84e-274269e20fe5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.435811] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-2695bb32-670b-49f4-b84e-274269e20fe5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.436063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.437161] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0da6d475-040d-43e8-9139-88652285a5fe with status ACTIVE [ 725.444187] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.444187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.444187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.444187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.444187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.444187] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.444187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.444187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.444187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.444187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.444187] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.444187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.444187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.444187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.444187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.444187] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0da6d475-040d-43e8-9139-88652285a5fe is going to be updated. [ 725.471800] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.471800] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.471800] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.471800] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.471800] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.472030] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0da6d475-040d-43e8-9139-88652285a5fe" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.554097] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 in Status: SUCCESS [ 725.554370] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 deletion is rescheduled due to dependency. [ 725.554527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.680268] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 946a4bb3-35a7-45bf-b93f-0879f8e48ab0: rpc.has_security_group_logging(os_id): False [ 725.711294] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.711527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.711527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.711789] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.711881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.712106] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.712433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.712508] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.712687] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.712884] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.713365] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.713365] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.713365] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.717101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.717101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.717101] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.717101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.717101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.717101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.717101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.717101] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 is going to be created. [ 725.834721] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.834721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.834721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.834721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.834721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.848592] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 in Status: IN_PROGRESS for 2s [ 725.937493] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2695bb32-670b-49f4-b84e-274269e20fe5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.342936] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc in Status: SUCCESS [ 726.343137] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.441102] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.441340] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.441439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.441706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.441811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.441930] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2695bb32-670b-49f4-b84e-274269e20fe5 is going to be created. [ 726.470430] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.470430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.470430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.470430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.470704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.485024] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2695bb32-670b-49f4-b84e-274269e20fe5 in Status: UNINITIALIZED for 2s [ 726.650865] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 726.651577] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.686173] env[70006]: INFO networking_nsxv3.common.synchronization [None req-a04759e0-cb25-4ea9-9cc9-8012d9ac959e None None] Enqueued Resource ID: 2ac995a3-7b37-4e75-a187-62d800ce9db5 with Priority: HIGHEST for action port [ 726.686173] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac995a3-7b37-4e75-a187-62d800ce9db5 with Priority: HIGHEST for action port [ 726.686537] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ac995a3-7b37-4e75-a187-62d800ce9db5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.686537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ac995a3-7b37-4e75-a187-62d800ce9db5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.686537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ac995a3-7b37-4e75-a187-62d800ce9db5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.686803] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ac995a3-7b37-4e75-a187-62d800ce9db5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.686882] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ac995a3-7b37-4e75-a187-62d800ce9db5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.037446] env[70006]: INFO networking_nsxv3.common.synchronization [req-aad0a085-a00d-4c57-980d-fc4fa9140110 req-8d196e7d-69ec-4451-bbcc-0d51f2b0acf1 tempest-InstanceActionsV221TestJSON-840280228 tempest-InstanceActionsV221TestJSON-840280228-project-member] Enqueued Resource ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 with Priority: HIGHEST for action security_group_members [ 727.038068] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 with Priority: HIGHEST for action security_group_members [ 727.039287] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d10f346-7e60-4bf9-a322-b64cbffea871 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.041832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.041832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.041832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.041832] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.041832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.041832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.041832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.041832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.041832] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d10f346-7e60-4bf9-a322-b64cbffea871',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.190726] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ac995a3-7b37-4e75-a187-62d800ce9db5 [ 727.191122] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.191299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.191451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.191735] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.191788] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.191882] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ac995a3-7b37-4e75-a187-62d800ce9db5 already deleted. [ 727.192049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ac995a3-7b37-4e75-a187-62d800ce9db5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.544299] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.544299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.544299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.544299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.544299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.544299] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.544299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.544745] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.544745] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.544745] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.544853] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 is going to be updated. [ 727.579749] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.580617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.581872] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.582120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.582315] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.596740] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 in Status: IN_PROGRESS for 2s [ 727.862302] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 in Status: SUCCESS [ 727.864394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.363250] env[70006]: INFO networking_nsxv3.common.synchronization [None req-4e615bf4-c94c-40cc-a873-489bf97d18b6 None None] Enqueued Resource ID: ebf2e37b-0590-454a-90a1-958ccc309162 with Priority: HIGHEST for action port [ 728.363425] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf2e37b-0590-454a-90a1-958ccc309162 with Priority: HIGHEST for action port [ 728.364031] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebf2e37b-0590-454a-90a1-958ccc309162 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.364174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebf2e37b-0590-454a-90a1-958ccc309162" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.364230] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebf2e37b-0590-454a-90a1-958ccc309162" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.365069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebf2e37b-0590-454a-90a1-958ccc309162" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.365069] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebf2e37b-0590-454a-90a1-958ccc309162',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.495666] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2695bb32-670b-49f4-b84e-274269e20fe5 in Status: SUCCESS [ 728.495908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.496100] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.496602] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.496862] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.497574] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.497656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.497844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.497932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.498033] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.498125] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2695bb32-670b-49f4-b84e-274269e20fe5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.870630] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebf2e37b-0590-454a-90a1-958ccc309162 [ 728.871136] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.871136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.871237] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.871445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.871548] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.871647] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebf2e37b-0590-454a-90a1-958ccc309162 already deleted. [ 728.871754] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebf2e37b-0590-454a-90a1-958ccc309162" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.000586] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2695bb32-670b-49f4-b84e-274269e20fe5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.033135] env[70006]: INFO networking_nsxv3.common.synchronization [None req-e372016f-b0e0-44e3-81a1-7d4a724ddf17 tempest-AttachVolumeNegativeTest-242855104 tempest-AttachVolumeNegativeTest-242855104-project-member] Enqueued Resource ID: d4596cda-f889-4b1b-8e98-7effb27170e9 with Priority: HIGHEST for action security_group_rules [ 729.033532] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4596cda-f889-4b1b-8e98-7effb27170e9 with Priority: HIGHEST for action security_group_rules [ 729.033841] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4596cda-f889-4b1b-8e98-7effb27170e9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.033963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.034036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.034290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.034368] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4596cda-f889-4b1b-8e98-7effb27170e9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.151221] env[70006]: INFO networking_nsxv3.common.synchronization [None req-e06229e5-1d2f-4784-80aa-e5c85f7fa586 tempest-AttachVolumeNegativeTest-242855104 tempest-AttachVolumeNegativeTest-242855104-project-member] Enqueued Resource ID: d4596cda-f889-4b1b-8e98-7effb27170e9 with Priority: HIGHEST for action security_group_rules [ 729.151429] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4596cda-f889-4b1b-8e98-7effb27170e9 with Priority: HIGHEST for action security_group_rules [ 729.152038] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4596cda-f889-4b1b-8e98-7effb27170e9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.152038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.505049] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2695bb32-670b-49f4-b84e-274269e20fe5: rpc.has_security_group_logging(os_id): False [ 729.528080] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.528080] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.528080] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.528344] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.528395] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.528738] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.528908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.528908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.529156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.529245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.529347] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2695bb32-670b-49f4-b84e-274269e20fe5 is going to be created. [ 729.563938] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.564119] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.564237] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.565368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.565531] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.565641] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4596cda-f889-4b1b-8e98-7effb27170e9 already deleted. [ 729.565753] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.565942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.566149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.566263] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4596cda-f889-4b1b-8e98-7effb27170e9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.616212] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.616212] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.616212] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.616461] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.616789] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.618354] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 in Status: SUCCESS [ 729.618684] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 deletion is rescheduled due to dependency. [ 729.618684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.632365] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2695bb32-670b-49f4-b84e-274269e20fe5 in Status: IN_PROGRESS for 2s [ 729.886386] env[70006]: INFO networking_nsxv3.common.synchronization [req-5cd53925-a5a0-42a9-8e16-67f8260b062e req-62e2a276-1af3-4466-84c4-5bef269270a8 tempest-ServerExternalEventsTest-1174324192 tempest-ServerExternalEventsTest-1174324192-project-member] Enqueued Resource ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f with Priority: HIGHEST for action security_group_members [ 729.886386] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f with Priority: HIGHEST for action security_group_members [ 729.888667] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.888903] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.888958] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.889282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.889471] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.889828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.889828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.889955] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.890079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.890189] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6541dc4e-5278-42ae-bed3-8ae1f828bb0f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.103230] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.103400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.103475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.103691] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.103790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.103888] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4596cda-f889-4b1b-8e98-7effb27170e9 already deleted. [ 730.103972] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.394552] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.394723] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.394811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.395076] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.395175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.395598] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.395598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.395598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.395598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.395855] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.395855] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f already deleted. [ 730.395855] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.448444] env[70006]: INFO networking_nsxv3.common.synchronization [None req-96faff75-998b-400b-9cd9-5b35b21b9b24 None None] Enqueued Resource ID: 5b523a18-0923-4a5d-af3f-a1d2afa1f63e with Priority: HIGHEST for action port [ 730.448444] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b523a18-0923-4a5d-af3f-a1d2afa1f63e with Priority: HIGHEST for action port [ 730.448444] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b523a18-0923-4a5d-af3f-a1d2afa1f63e taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.448444] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b523a18-0923-4a5d-af3f-a1d2afa1f63e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.448444] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b523a18-0923-4a5d-af3f-a1d2afa1f63e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.449456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b523a18-0923-4a5d-af3f-a1d2afa1f63e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.449524] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b523a18-0923-4a5d-af3f-a1d2afa1f63e',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.670704] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.674018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.674018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.674018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.674018] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.674018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.674018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.674018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.674018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.674018] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 730.674018] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.674018] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.674018] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.674018] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 730.674018] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.674574] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.703116] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.703116] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 730.703116] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.703116] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.703116] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-c4a28327-a59d-44df-9cc4-ee9bcd50c21e taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.703116] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-c4a28327-a59d-44df-9cc4-ee9bcd50c21e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.703116] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-c4a28327-a59d-44df-9cc4-ee9bcd50c21e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.703116] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-c4a28327-a59d-44df-9cc4-ee9bcd50c21e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.703116] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4a28327-a59d-44df-9cc4-ee9bcd50c21e',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.935199] env[70006]: INFO networking_nsxv3.common.synchronization [None req-fec8e915-9822-4dab-be12-8d42088a0b8f None None] Enqueued Resource ID: db4be9d0-5b78-444f-9a63-4cb0812a3192 with Priority: HIGHEST for action port [ 730.935494] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4be9d0-5b78-444f-9a63-4cb0812a3192 with Priority: HIGHEST for action port [ 730.936074] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-db4be9d0-5b78-444f-9a63-4cb0812a3192 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.936207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db4be9d0-5b78-444f-9a63-4cb0812a3192" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.936268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db4be9d0-5b78-444f-9a63-4cb0812a3192" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.936527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db4be9d0-5b78-444f-9a63-4cb0812a3192" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.936633] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db4be9d0-5b78-444f-9a63-4cb0812a3192',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.951905] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b523a18-0923-4a5d-af3f-a1d2afa1f63e [ 730.952254] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.952431] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.952479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.952697] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.952796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.952938] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b523a18-0923-4a5d-af3f-a1d2afa1f63e already deleted. [ 730.953084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b523a18-0923-4a5d-af3f-a1d2afa1f63e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.206437] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.209157] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.209157] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.209157] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.209157] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.209157] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port c4a28327-a59d-44df-9cc4-ee9bcd50c21e not found, creating... [ 731.209157] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.209157] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.209157] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.209157] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.209157] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.209638] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.209638] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.210764] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.211385] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.211702] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.212345] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: c4a28327-a59d-44df-9cc4-ee9bcd50c21e is going to be created. [ 731.237151] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.237959] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.239770] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.239770] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.239770] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.239770] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-c4a28327-a59d-44df-9cc4-ee9bcd50c21e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.445589] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db4be9d0-5b78-444f-9a63-4cb0812a3192 [ 731.445589] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.445589] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.445589] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.445589] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.445589] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.445589] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db4be9d0-5b78-444f-9a63-4cb0812a3192 already deleted. [ 731.445589] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db4be9d0-5b78-444f-9a63-4cb0812a3192" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.648298] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2695bb32-670b-49f4-b84e-274269e20fe5 in Status: SUCCESS [ 731.648298] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.341625] env[70006]: INFO networking_nsxv3.common.synchronization [req-5cd53925-a5a0-42a9-8e16-67f8260b062e req-39d5d5c2-bbd9-42f4-9ed3-653367ac838b service nova] Enqueued Resource ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f with Priority: HIGHEST for action security_group_rules [ 732.342191] env[70006]: INFO networking_nsxv3.common.synchronization [req-5cd53925-a5a0-42a9-8e16-67f8260b062e req-39d5d5c2-bbd9-42f4-9ed3-653367ac838b service nova] Enqueued Resource ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f with Priority: HIGHEST for action security_group_members [ 732.342191] env[70006]: INFO networking_nsxv3.common.synchronization [req-5cd53925-a5a0-42a9-8e16-67f8260b062e req-39d5d5c2-bbd9-42f4-9ed3-653367ac838b service nova] Enqueued Resource ID: c4a28327-a59d-44df-9cc4-ee9bcd50c21e with Priority: HIGHEST for action port [ 732.342597] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f with Priority: HIGHEST for action security_group_rules [ 732.342739] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f with Priority: HIGHEST for action security_group_members [ 732.342836] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a28327-a59d-44df-9cc4-ee9bcd50c21e with Priority: HIGHEST for action port [ 732.343258] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6541dc4e-5278-42ae-bed3-8ae1f828bb0f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.343485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.343659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.343948] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.344232] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6541dc4e-5278-42ae-bed3-8ae1f828bb0f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.345551] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.346588] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.346808] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.347147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.347929] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.348139] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.348251] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.348662] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.348662] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.348883] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6541dc4e-5278-42ae-bed3-8ae1f828bb0f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.351351] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4a28327-a59d-44df-9cc4-ee9bcd50c21e taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.351954] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4a28327-a59d-44df-9cc4-ee9bcd50c21e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.352478] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4a28327-a59d-44df-9cc4-ee9bcd50c21e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.352847] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4a28327-a59d-44df-9cc4-ee9bcd50c21e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.352950] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4a28327-a59d-44df-9cc4-ee9bcd50c21e',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.359197] env[70006]: INFO networking_nsxv3.common.synchronization [req-35761083-c4b5-472b-9547-0a62c3397e71 req-593e73fa-6b2d-4f3f-8f06-e998acd659c8 tempest-DeleteServersTestJSON-472565240 tempest-DeleteServersTestJSON-472565240-project-member] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 732.359197] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 732.359197] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.359197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.359197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.359557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.359557] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.359875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.359875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.359875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.360089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.360249] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.856782] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.856782] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.856782] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6541dc4e-5278-42ae-bed3-8ae1f828bb0f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.858611] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4a28327-a59d-44df-9cc4-ee9bcd50c21e with status ACTIVE [ 732.860015] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.860015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.860015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.860015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.860015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.860360] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.860433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.860502] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.860686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.860768] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.861051] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.862070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.862070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.862070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.862070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.862070] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4a28327-a59d-44df-9cc4-ee9bcd50c21e is going to be updated. [ 732.863100] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.863234] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.863299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.863462] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.864110] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.865765] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.865765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.865765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.865765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.865765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.865765] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 already deleted. [ 732.865765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.886506] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.887020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.887020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.887197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.887294] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.887509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4a28327-a59d-44df-9cc4-ee9bcd50c21e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.953061] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.955036] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.955036] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.955036] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.955036] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.955036] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.955036] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.955036] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.955036] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.955036] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.955528] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.955528] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.955528] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.955528] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.955677] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.955728] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.982850] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.983079] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 732.983263] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.983576] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.983945] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-4f1ea900-8772-4876-82d4-0c75f8ab8e22 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.984153] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-4f1ea900-8772-4876-82d4-0c75f8ab8e22" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.984626] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-4f1ea900-8772-4876-82d4-0c75f8ab8e22" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.984709] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-4f1ea900-8772-4876-82d4-0c75f8ab8e22" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.984783] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f1ea900-8772-4876-82d4-0c75f8ab8e22',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.365391] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6541dc4e-5278-42ae-bed3-8ae1f828bb0f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.487918] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.489396] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.489463] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.490142] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.491122] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.491382] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 4f1ea900-8772-4876-82d4-0c75f8ab8e22 not found, creating... [ 733.491609] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.491760] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.491995] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.492164] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.492309] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.492613] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.492795] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.492886] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.493129] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.493267] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.493406] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 4f1ea900-8772-4876-82d4-0c75f8ab8e22 is going to be created. [ 733.521178] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.521178] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.521178] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.521518] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.521944] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.522069] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-4f1ea900-8772-4876-82d4-0c75f8ab8e22" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.660145] env[70006]: INFO networking_nsxv3.common.synchronization [req-d34ac467-7773-4252-abd2-a2018dc26168 req-b37c6a1d-b84f-45f9-af07-f0945d7616bc tempest-AttachInterfacesV270Test-841799969 tempest-AttachInterfacesV270Test-841799969-project-member] Enqueued Resource ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc with Priority: HIGHEST for action security_group_members [ 733.660914] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc with Priority: HIGHEST for action security_group_members [ 733.661108] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.661258] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.661315] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.661607] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.661680] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.661734] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.661842] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.666024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.666024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.666024] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.867634] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.867805] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.867969] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.868162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.868260] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.868423] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f is going to be created. [ 733.894207] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.894433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.894433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.894646] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.894984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.906861] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f in Status: UNINITIALIZED for 2s [ 734.116924] env[70006]: INFO networking_nsxv3.common.synchronization [None req-f32aae9c-7da8-455c-b998-603137a6fc1e None None] Enqueued Resource ID: 45081792-b1fa-4bf1-9250-c8ee6e0da2c9 with Priority: HIGHEST for action port [ 734.117709] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45081792-b1fa-4bf1-9250-c8ee6e0da2c9 with Priority: HIGHEST for action port [ 734.118210] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-45081792-b1fa-4bf1-9250-c8ee6e0da2c9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.119473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45081792-b1fa-4bf1-9250-c8ee6e0da2c9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.119473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45081792-b1fa-4bf1-9250-c8ee6e0da2c9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.119473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45081792-b1fa-4bf1-9250-c8ee6e0da2c9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.119473] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45081792-b1fa-4bf1-9250-c8ee6e0da2c9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.165321] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.165456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.165684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.165921] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.166027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.166241] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.166377] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.166428] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.166753] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.166753] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.166866] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc is going to be updated. [ 734.212823] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.212823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.213024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.216024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.216024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.226022] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc in Status: IN_PROGRESS for 2s [ 734.331323] env[70006]: INFO networking_nsxv3.common.synchronization [req-35761083-c4b5-472b-9547-0a62c3397e71 req-74214fa1-bf59-4666-a37f-5887dbf0822e service nova] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_rules [ 734.332901] env[70006]: INFO networking_nsxv3.common.synchronization [req-35761083-c4b5-472b-9547-0a62c3397e71 req-74214fa1-bf59-4666-a37f-5887dbf0822e service nova] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 734.332901] env[70006]: INFO networking_nsxv3.common.synchronization [req-35761083-c4b5-472b-9547-0a62c3397e71 req-74214fa1-bf59-4666-a37f-5887dbf0822e service nova] Enqueued Resource ID: 4f1ea900-8772-4876-82d4-0c75f8ab8e22 with Priority: HIGHEST for action port [ 734.334147] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_rules [ 734.334476] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 734.334603] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f1ea900-8772-4876-82d4-0c75f8ab8e22 with Priority: HIGHEST for action port [ 734.335941] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.335941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.335941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.335941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.335941] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.338107] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.338335] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.338427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.339136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.339136] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.339316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.339316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.339820] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.339820] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.339948] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.340934] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f1ea900-8772-4876-82d4-0c75f8ab8e22 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.341063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f1ea900-8772-4876-82d4-0c75f8ab8e22" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.341268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f1ea900-8772-4876-82d4-0c75f8ab8e22" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.341333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f1ea900-8772-4876-82d4-0c75f8ab8e22" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.341383] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f1ea900-8772-4876-82d4-0c75f8ab8e22',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.621673] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45081792-b1fa-4bf1-9250-c8ee6e0da2c9 [ 734.621922] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.622062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.622134] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.622352] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.622442] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.622536] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45081792-b1fa-4bf1-9250-c8ee6e0da2c9 already deleted. [ 734.622621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45081792-b1fa-4bf1-9250-c8ee6e0da2c9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.839606] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.839812] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.844061] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.846250] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f1ea900-8772-4876-82d4-0c75f8ab8e22 with status ACTIVE [ 734.846250] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.846766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.846766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.848857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.848857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.848857] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.848857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.848857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.848857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.848857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.848857] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.848857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.848857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.848857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.848857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.848857] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f1ea900-8772-4876-82d4-0c75f8ab8e22 is going to be updated. [ 734.878843] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.880327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.880327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.880327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.880327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.880327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f1ea900-8772-4876-82d4-0c75f8ab8e22" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.177991] env[70006]: INFO networking_nsxv3.common.synchronization [req-5ad06ef3-4878-4fd4-8723-875c2bb2817d req-e8a0a4fb-ff7f-4f40-8656-6deab91e2dcd tempest-VolumesAssistedSnapshotsTest-275775559 tempest-VolumesAssistedSnapshotsTest-275775559-project-member] Enqueued Resource ID: 2d0a478f-3de2-453c-980b-25efdb42c355 with Priority: HIGHEST for action security_group_members [ 735.178808] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d0a478f-3de2-453c-980b-25efdb42c355 with Priority: HIGHEST for action security_group_members [ 735.180139] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d0a478f-3de2-453c-980b-25efdb42c355 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.180314] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.180407] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.180703] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.181031] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.181221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.181363] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.181638] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.181764] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.181953] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d0a478f-3de2-453c-980b-25efdb42c355',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.350843] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.686157] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.686631] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.686740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.686987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.687134] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.687573] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.687761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.688120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.688120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.688243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.688243] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d0a478f-3de2-453c-980b-25efdb42c355 already deleted. [ 735.688321] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.855961] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.856162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.856207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.856806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.856806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.856806] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be created. [ 735.884698] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.884973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.884973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.886229] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.886229] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.896790] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: UNINITIALIZED for 2s [ 735.917838] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f in Status: SUCCESS [ 735.917838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.917838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.917838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.918077] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.918077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.918184] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.918256] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.918330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.918419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.918514] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6541dc4e-5278-42ae-bed3-8ae1f828bb0f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.109958] env[70006]: INFO networking_nsxv3.common.synchronization [None req-f77c0a49-9675-4353-827a-89be42b12804 None None] Enqueued Resource ID: 9f07dc61-f62d-4b59-8030-a28f8626919f with Priority: HIGHEST for action port [ 736.109958] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f07dc61-f62d-4b59-8030-a28f8626919f with Priority: HIGHEST for action port [ 736.109958] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f07dc61-f62d-4b59-8030-a28f8626919f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.109958] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f07dc61-f62d-4b59-8030-a28f8626919f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.109958] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f07dc61-f62d-4b59-8030-a28f8626919f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.109958] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f07dc61-f62d-4b59-8030-a28f8626919f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.109958] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f07dc61-f62d-4b59-8030-a28f8626919f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.150337] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-767 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.152208] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-767" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.153015] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-767" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.153311] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-767" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.157017] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.157017] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.157017] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.157017] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.157017] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.157017] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.157017] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.157017] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.157017] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.157017] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.157017] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.157017] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.185681] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.185681] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 736.185681] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.185681] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-767" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.185681] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-47970e5c-2dab-40b7-abcc-f2bc90bcfad7 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.185681] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-47970e5c-2dab-40b7-abcc-f2bc90bcfad7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.185681] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-47970e5c-2dab-40b7-abcc-f2bc90bcfad7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.188084] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-47970e5c-2dab-40b7-abcc-f2bc90bcfad7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.188084] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47970e5c-2dab-40b7-abcc-f2bc90bcfad7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.241893] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc in Status: SUCCESS [ 736.242109] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc deletion is rescheduled due to dependency. [ 736.242231] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.421378] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.422377] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.422846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.423991] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.424318] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.424595] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.424889] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.428304] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.428423] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.428533] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.428773] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.428887] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.428952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.429211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.429279] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.429373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.429431] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.429575] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.429655] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.429738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.429827] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6541dc4e-5278-42ae-bed3-8ae1f828bb0f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.613168] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f07dc61-f62d-4b59-8030-a28f8626919f [ 736.613407] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.613541] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.613608] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.613840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.613927] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.614032] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f07dc61-f62d-4b59-8030-a28f8626919f already deleted. [ 736.614113] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f07dc61-f62d-4b59-8030-a28f8626919f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.692722] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.693066] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.695275] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.696073] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.696073] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.696253] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 47970e5c-2dab-40b7-abcc-f2bc90bcfad7 not found, creating... [ 736.697475] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.697475] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.697475] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.697475] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.697475] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.697475] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.697782] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.697782] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.697924] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.698188] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.698367] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 47970e5c-2dab-40b7-abcc-f2bc90bcfad7 is going to be created. [ 736.723260] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.723260] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.723380] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.723647] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.723977] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.724136] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-47970e5c-2dab-40b7-abcc-f2bc90bcfad7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.741563] env[70006]: INFO networking_nsxv3.common.synchronization [req-8ef75a04-d9b1-44b3-b050-96324b08d6fd req-48bae0c3-8065-43ea-adff-e41d401956c6 tempest-ServerDiagnosticsNegativeTest-1600725784 tempest-ServerDiagnosticsNegativeTest-1600725784-project-member] Enqueued Resource ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 with Priority: HIGHEST for action security_group_members [ 736.741563] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 with Priority: HIGHEST for action security_group_members [ 736.741563] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.741563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.741563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.745197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.745400] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.745555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.745603] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.745769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.745866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.745956] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('946a4bb3-35a7-45bf-b93f-0879f8e48ab0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.935020] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6541dc4e-5278-42ae-bed3-8ae1f828bb0f: rpc.has_security_group_logging(os_id): False [ 736.958295] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.958508] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.958508] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.960619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.960619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.960619] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.960619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.960619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.960619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.960619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.960619] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.960619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.960619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.960619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.960619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.960619] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.961328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.961328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.961328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.966042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.966042] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f is going to be created. [ 737.035661] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.035881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.036028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.036286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.036517] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.052741] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f in Status: IN_PROGRESS for 2s [ 737.256513] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.256513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.256513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.256513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.256513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.256513] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.256513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.256513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.256513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.256513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.256513] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 is going to be updated. [ 737.287105] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.289115] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.289115] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.289115] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.289115] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.299411] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 in Status: IN_PROGRESS for 2s [ 737.524830] env[70006]: INFO networking_nsxv3.common.synchronization [None req-e7f54bec-2077-4cb7-b4b4-e42bdfe0abc7 None None] Enqueued Resource ID: cbc2b684-61c9-40b8-bfa9-c6a079286a47 with Priority: HIGHEST for action port [ 737.524830] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc2b684-61c9-40b8-bfa9-c6a079286a47 with Priority: HIGHEST for action port [ 737.525215] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbc2b684-61c9-40b8-bfa9-c6a079286a47 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.525334] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbc2b684-61c9-40b8-bfa9-c6a079286a47" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.525398] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbc2b684-61c9-40b8-bfa9-c6a079286a47" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.525661] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbc2b684-61c9-40b8-bfa9-c6a079286a47" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.525733] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbc2b684-61c9-40b8-bfa9-c6a079286a47',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.807985] env[70006]: INFO networking_nsxv3.common.synchronization [req-5ad06ef3-4878-4fd4-8723-875c2bb2817d req-b4f2af64-d0ea-453c-98d5-93d39ac4398e service nova] Enqueued Resource ID: 2d0a478f-3de2-453c-980b-25efdb42c355 with Priority: HIGHEST for action security_group_rules [ 737.807985] env[70006]: INFO networking_nsxv3.common.synchronization [req-5ad06ef3-4878-4fd4-8723-875c2bb2817d req-b4f2af64-d0ea-453c-98d5-93d39ac4398e service nova] Enqueued Resource ID: 2d0a478f-3de2-453c-980b-25efdb42c355 with Priority: HIGHEST for action security_group_members [ 737.807985] env[70006]: INFO networking_nsxv3.common.synchronization [req-5ad06ef3-4878-4fd4-8723-875c2bb2817d req-b4f2af64-d0ea-453c-98d5-93d39ac4398e service nova] Enqueued Resource ID: 47970e5c-2dab-40b7-abcc-f2bc90bcfad7 with Priority: HIGHEST for action port [ 737.807985] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d0a478f-3de2-453c-980b-25efdb42c355 with Priority: HIGHEST for action security_group_rules [ 737.807985] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d0a478f-3de2-453c-980b-25efdb42c355 with Priority: HIGHEST for action security_group_members [ 737.807985] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47970e5c-2dab-40b7-abcc-f2bc90bcfad7 with Priority: HIGHEST for action port [ 737.812457] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d0a478f-3de2-453c-980b-25efdb42c355 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.812609] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.812678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.812891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.812971] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d0a478f-3de2-453c-980b-25efdb42c355',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.816472] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d0a478f-3de2-453c-980b-25efdb42c355 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.816645] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.820971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.820971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.820971] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.820971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.820971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.820971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.820971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.820971] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d0a478f-3de2-453c-980b-25efdb42c355',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.823544] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-47970e5c-2dab-40b7-abcc-f2bc90bcfad7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.823544] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47970e5c-2dab-40b7-abcc-f2bc90bcfad7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.823544] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47970e5c-2dab-40b7-abcc-f2bc90bcfad7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.823544] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47970e5c-2dab-40b7-abcc-f2bc90bcfad7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.823544] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47970e5c-2dab-40b7-abcc-f2bc90bcfad7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.908085] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 737.908085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.908085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.908085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.908085] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.908085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.908423] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.908423] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.908423] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.908516] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.908548] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.032065] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbc2b684-61c9-40b8-bfa9-c6a079286a47 [ 738.036372] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.036372] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.036372] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.036372] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.036372] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.036372] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbc2b684-61c9-40b8-bfa9-c6a079286a47 already deleted. [ 738.036372] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbc2b684-61c9-40b8-bfa9-c6a079286a47" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.317156] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d0a478f-3de2-453c-980b-25efdb42c355 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.317324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.328457] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d0a478f-3de2-453c-980b-25efdb42c355',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.329433] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47970e5c-2dab-40b7-abcc-f2bc90bcfad7 with status ACTIVE [ 738.329662] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.329802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.329871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.330100] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.330195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.330398] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.330498] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.330572] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.330739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.330820] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.331082] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.331178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.331214] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.331363] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.331439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.331544] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47970e5c-2dab-40b7-abcc-f2bc90bcfad7 is going to be updated. [ 738.362877] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.362877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.362877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.362877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.362877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.362877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47970e5c-2dab-40b7-abcc-f2bc90bcfad7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.413281] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.413502] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.413579] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.414088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.414088] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.414088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.414281] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.414281] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.414374] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.414463] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.414608] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.414699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.414757] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.414908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.415246] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.415246] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.415246] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.415450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.415450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.415551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.415599] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.837417] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d0a478f-3de2-453c-980b-25efdb42c355',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.914263] env[70006]: INFO networking_nsxv3.common.synchronization [None req-47c3514a-295f-4a70-b709-db4fe356d93a None None] Enqueued Resource ID: 28cbe9c9-719c-4600-9d34-e1e013d4610c with Priority: HIGHEST for action port [ 738.920243] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28cbe9c9-719c-4600-9d34-e1e013d4610c with Priority: HIGHEST for action port [ 738.920243] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5: rpc.has_security_group_logging(os_id): False [ 738.922096] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-28cbe9c9-719c-4600-9d34-e1e013d4610c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.922296] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28cbe9c9-719c-4600-9d34-e1e013d4610c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.922396] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28cbe9c9-719c-4600-9d34-e1e013d4610c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.922712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28cbe9c9-719c-4600-9d34-e1e013d4610c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.922943] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28cbe9c9-719c-4600-9d34-e1e013d4610c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.946882] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.947060] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.947108] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.948287] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.948342] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.948861] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.948861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.948861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.949061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.949061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.949149] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.949236] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.950472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.950472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.950472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.950472] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.950472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.950472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.950472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.952248] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.952421] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be created. [ 739.017164] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.017164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.017164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.020186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.020435] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.033062] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 739.065814] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f in Status: SUCCESS [ 739.066119] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.311482] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 in Status: SUCCESS [ 739.311686] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 deletion is rescheduled due to dependency. [ 739.311803] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.338804] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.339072] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.339072] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.339299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.339454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.339526] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d0a478f-3de2-453c-980b-25efdb42c355 is going to be created. [ 739.369708] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.369936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.369987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.370271] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.370402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.381058] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d0a478f-3de2-453c-980b-25efdb42c355 in Status: UNINITIALIZED for 2s [ 739.425722] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28cbe9c9-719c-4600-9d34-e1e013d4610c [ 739.425911] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.426092] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.426163] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.426416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.426519] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.426654] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28cbe9c9-719c-4600-9d34-e1e013d4610c already deleted. [ 739.426902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28cbe9c9-719c-4600-9d34-e1e013d4610c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.185246] env[70006]: INFO networking_nsxv3.common.synchronization [None req-ac5755b9-07bb-4b71-a8ee-dd087e420bb8 None None] Enqueued Resource ID: 6de9248e-0108-4689-83ad-d5f3d798d6b8 with Priority: HIGHEST for action port [ 740.185556] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9248e-0108-4689-83ad-d5f3d798d6b8 with Priority: HIGHEST for action port [ 740.186085] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-6de9248e-0108-4689-83ad-d5f3d798d6b8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.186236] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6de9248e-0108-4689-83ad-d5f3d798d6b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.186308] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6de9248e-0108-4689-83ad-d5f3d798d6b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.186555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6de9248e-0108-4689-83ad-d5f3d798d6b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.186702] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6de9248e-0108-4689-83ad-d5f3d798d6b8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.323801] env[70006]: INFO networking_nsxv3.common.synchronization [None req-e53a19bf-c158-4d15-acdc-babdfa4e899c tempest-ServerActionsV293TestJSON-630636606 tempest-ServerActionsV293TestJSON-630636606-project-member] Enqueued Resource ID: b62110f9-4181-4c43-9e99-43fd5dff214d with Priority: HIGHEST for action security_group_rules [ 740.324150] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62110f9-4181-4c43-9e99-43fd5dff214d with Priority: HIGHEST for action security_group_rules [ 740.324468] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b62110f9-4181-4c43-9e99-43fd5dff214d taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.324612] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.324683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.325101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.325101] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b62110f9-4181-4c43-9e99-43fd5dff214d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.540412] env[70006]: INFO networking_nsxv3.common.synchronization [None req-730f172d-2ed4-4125-8994-0c010527ad91 tempest-ServerActionsV293TestJSON-630636606 tempest-ServerActionsV293TestJSON-630636606-project-member] Enqueued Resource ID: b62110f9-4181-4c43-9e99-43fd5dff214d with Priority: HIGHEST for action security_group_rules [ 740.540984] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62110f9-4181-4c43-9e99-43fd5dff214d with Priority: HIGHEST for action security_group_rules [ 740.541410] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b62110f9-4181-4c43-9e99-43fd5dff214d taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.541546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.691858] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6de9248e-0108-4689-83ad-d5f3d798d6b8 [ 740.691969] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.692136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.692190] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.692419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.692507] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.692599] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6de9248e-0108-4689-83ad-d5f3d798d6b8 already deleted. [ 740.693526] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6de9248e-0108-4689-83ad-d5f3d798d6b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.854916] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.854916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.854916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.855523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.855523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.855523] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b62110f9-4181-4c43-9e99-43fd5dff214d already deleted. [ 740.855523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.855708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.855751] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.856046] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b62110f9-4181-4c43-9e99-43fd5dff214d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.045558] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 741.046500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.345177] env[70006]: INFO networking_nsxv3.common.synchronization [req-bca2ff74-ed5a-4954-8611-0f71131688a7 req-e457c961-6524-4813-909a-befd44ea48e7 tempest-ImagesOneServerTestJSON-378500094 tempest-ImagesOneServerTestJSON-378500094-project-member] Enqueued Resource ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a with Priority: HIGHEST for action security_group_members [ 741.345673] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a with Priority: HIGHEST for action security_group_members [ 741.346383] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.346706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.346778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.347583] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.349197] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.349197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.349443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.349851] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.350547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.350547] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07080bbd-9bb6-4803-a5af-fb39eb3eee3a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.384415] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.384415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.384415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.384701] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.384701] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.384701] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b62110f9-4181-4c43-9e99-43fd5dff214d already deleted. [ 741.384796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.404022] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d0a478f-3de2-453c-980b-25efdb42c355 in Status: SUCCESS [ 741.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.404022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.404022] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d0a478f-3de2-453c-980b-25efdb42c355',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.741359] env[70006]: INFO networking_nsxv3.common.synchronization [None req-900a98f6-c0c5-49d2-902d-a99973e40b42 None None] Enqueued Resource ID: 36aabddc-09f2-4f9d-91f3-b72c644e6612 with Priority: HIGHEST for action port [ 741.741359] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36aabddc-09f2-4f9d-91f3-b72c644e6612 with Priority: HIGHEST for action port [ 741.741359] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-36aabddc-09f2-4f9d-91f3-b72c644e6612 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.741359] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36aabddc-09f2-4f9d-91f3-b72c644e6612" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.743172] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36aabddc-09f2-4f9d-91f3-b72c644e6612" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.743782] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36aabddc-09f2-4f9d-91f3-b72c644e6612" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.744718] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36aabddc-09f2-4f9d-91f3-b72c644e6612',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.853236] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.853407] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.853467] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.853689] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.853778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.854012] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.854109] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.854275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.854338] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.854381] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.854436] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a already deleted. [ 741.854514] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.909883] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d0a478f-3de2-453c-980b-25efdb42c355',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.121478] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.121700] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-463" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.121828] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-463" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.122440] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-463" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.122742] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.123308] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.123384] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.123573] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.123726] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.123937] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.124067] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.124180] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.124290] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.124404] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.124692] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.124864] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.145719] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.145891] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 742.146309] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.146309] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-463" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.150611] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-3e878689-ac09-469d-8490-a73b6e02d403 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.150611] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-3e878689-ac09-469d-8490-a73b6e02d403" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.150611] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-3e878689-ac09-469d-8490-a73b6e02d403" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.150611] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-3e878689-ac09-469d-8490-a73b6e02d403" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.150611] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e878689-ac09-469d-8490-a73b6e02d403',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.249114] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36aabddc-09f2-4f9d-91f3-b72c644e6612 [ 742.249424] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.249648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.249755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.249975] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.250102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.250439] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36aabddc-09f2-4f9d-91f3-b72c644e6612 already deleted. [ 742.250539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36aabddc-09f2-4f9d-91f3-b72c644e6612" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.413926] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d0a478f-3de2-453c-980b-25efdb42c355: rpc.has_security_group_logging(os_id): False [ 742.435980] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.436189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.436293] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.436605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.436719] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.437030] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.437112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.437354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.437636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.437672] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.437756] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d0a478f-3de2-453c-980b-25efdb42c355 is going to be created. [ 742.511973] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.512156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.512220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.512484] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.512697] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.530419] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d0a478f-3de2-453c-980b-25efdb42c355 in Status: IN_PROGRESS for 2s [ 742.655155] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.655396] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.655544] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.655844] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.655987] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.656157] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 3e878689-ac09-469d-8490-a73b6e02d403 not found, creating... [ 742.656429] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.656598] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.656714] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.656948] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.657167] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.657579] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.659892] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.660122] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.660378] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.660536] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.660758] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 3e878689-ac09-469d-8490-a73b6e02d403 is going to be created. [ 742.687155] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.687372] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.687495] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.687804] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.690403] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.690736] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-3e878689-ac09-469d-8490-a73b6e02d403" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.904016] env[70006]: INFO networking_nsxv3.common.synchronization [req-bca2ff74-ed5a-4954-8611-0f71131688a7 req-d5c6e0ee-00ca-4df5-ba06-22174cb9ff5f service nova] Enqueued Resource ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a with Priority: HIGHEST for action security_group_rules [ 743.904016] env[70006]: INFO networking_nsxv3.common.synchronization [req-bca2ff74-ed5a-4954-8611-0f71131688a7 req-d5c6e0ee-00ca-4df5-ba06-22174cb9ff5f service nova] Enqueued Resource ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a with Priority: HIGHEST for action security_group_members [ 743.904016] env[70006]: INFO networking_nsxv3.common.synchronization [req-bca2ff74-ed5a-4954-8611-0f71131688a7 req-d5c6e0ee-00ca-4df5-ba06-22174cb9ff5f service nova] Enqueued Resource ID: 3e878689-ac09-469d-8490-a73b6e02d403 with Priority: HIGHEST for action port [ 743.904684] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a with Priority: HIGHEST for action security_group_rules [ 743.904900] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a with Priority: HIGHEST for action security_group_members [ 743.904900] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e878689-ac09-469d-8490-a73b6e02d403 with Priority: HIGHEST for action port [ 743.905824] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07080bbd-9bb6-4803-a5af-fb39eb3eee3a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.905824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.905824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.906021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.906021] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07080bbd-9bb6-4803-a5af-fb39eb3eee3a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.907958] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.907958] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.907958] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.907958] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.908652] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.908652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.908652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.908652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.908652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.908839] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07080bbd-9bb6-4803-a5af-fb39eb3eee3a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.911088] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e878689-ac09-469d-8490-a73b6e02d403 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.911088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e878689-ac09-469d-8490-a73b6e02d403" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.911088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e878689-ac09-469d-8490-a73b6e02d403" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.911088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e878689-ac09-469d-8490-a73b6e02d403" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.911088] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e878689-ac09-469d-8490-a73b6e02d403',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.049290] env[70006]: INFO networking_nsxv3.common.synchronization [None req-f5cae921-26e4-4e97-80ac-dbbc45268ecc None None] Enqueued Resource ID: ccfc2efb-4297-401d-a401-e1fb2107a7b9 with Priority: HIGHEST for action port [ 744.049290] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccfc2efb-4297-401d-a401-e1fb2107a7b9 with Priority: HIGHEST for action port [ 744.049589] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccfc2efb-4297-401d-a401-e1fb2107a7b9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.049785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccfc2efb-4297-401d-a401-e1fb2107a7b9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.049847] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccfc2efb-4297-401d-a401-e1fb2107a7b9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.050441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccfc2efb-4297-401d-a401-e1fb2107a7b9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.051546] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccfc2efb-4297-401d-a401-e1fb2107a7b9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.411152] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07080bbd-9bb6-4803-a5af-fb39eb3eee3a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.412854] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e878689-ac09-469d-8490-a73b6e02d403 with status ACTIVE [ 744.413336] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.413497] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.413593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.413817] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.413930] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.414137] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.414238] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.414306] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.414467] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.414547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.414759] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.414821] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.414873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.415028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.415107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.415192] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e878689-ac09-469d-8490-a73b6e02d403 is going to be updated. [ 744.416429] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.416542] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.426451] env[70006]: INFO networking_nsxv3.common.synchronization [req-e6407ee1-70d5-4c39-b821-7b1e64022e29 req-895e5c41-920a-4933-90d4-670e95461541 tempest-ServersWithSpecificFlavorTestJSON-1233962006 tempest-ServersWithSpecificFlavorTestJSON-1233962006-project-member] Enqueued Resource ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 with Priority: HIGHEST for action security_group_members [ 744.426451] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 with Priority: HIGHEST for action security_group_members [ 744.426451] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.426451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.426451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.426451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.426451] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.426451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.426451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.426451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.426451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.426451] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('caa33f7e-8d3a-4a22-985b-0a592f9b03a1',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.442089] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.442245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.442325] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.442634] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.442818] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.443023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e878689-ac09-469d-8490-a73b6e02d403" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.550153] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d0a478f-3de2-453c-980b-25efdb42c355 in Status: SUCCESS [ 744.550505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.552756] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ccfc2efb-4297-401d-a401-e1fb2107a7b9 [ 744.553033] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.553188] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.553258] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.553474] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.553600] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.553916] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ccfc2efb-4297-401d-a401-e1fb2107a7b9 already deleted. [ 744.553916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccfc2efb-4297-401d-a401-e1fb2107a7b9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.914018] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07080bbd-9bb6-4803-a5af-fb39eb3eee3a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.932186] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.932186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.932297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.932415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.932504] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.932701] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.932799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.932862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.933022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.933101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.933189] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 already deleted. [ 744.933267] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.142137] env[70006]: INFO networking_nsxv3.common.synchronization [None req-42460425-28ec-4ede-b87b-4cc980c26967 None None] Enqueued Resource ID: e6cdf42d-52d0-472d-a36e-b9b1b2c0d8c2 with Priority: HIGHEST for action port [ 745.142298] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6cdf42d-52d0-472d-a36e-b9b1b2c0d8c2 with Priority: HIGHEST for action port [ 745.150241] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6cdf42d-52d0-472d-a36e-b9b1b2c0d8c2 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.150241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6cdf42d-52d0-472d-a36e-b9b1b2c0d8c2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.150241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6cdf42d-52d0-472d-a36e-b9b1b2c0d8c2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.150241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6cdf42d-52d0-472d-a36e-b9b1b2c0d8c2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.150497] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6cdf42d-52d0-472d-a36e-b9b1b2c0d8c2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.419809] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.419809] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.419809] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.420434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.420434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.420434] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a is going to be created. [ 745.451297] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.451507] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.451507] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.454022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.454022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.465248] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a in Status: UNINITIALIZED for 2s [ 745.527922] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-282 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.528142] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-282" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.528274] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-282" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.528616] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-282" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.529307] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.529834] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.530141] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.530566] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.530810] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.531193] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.531830] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.531996] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.532158] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.532301] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.532436] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.532600] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.563179] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.563267] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 745.563453] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.565394] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-282" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.565394] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-7634504a-a16c-44ea-9a82-e8f88bcc65ea taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.565394] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-7634504a-a16c-44ea-9a82-e8f88bcc65ea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.565394] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-7634504a-a16c-44ea-9a82-e8f88bcc65ea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.565394] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-7634504a-a16c-44ea-9a82-e8f88bcc65ea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.565394] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7634504a-a16c-44ea-9a82-e8f88bcc65ea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.654565] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6cdf42d-52d0-472d-a36e-b9b1b2c0d8c2 [ 745.654803] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.654946] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.655025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.655260] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.655358] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.655457] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6cdf42d-52d0-472d-a36e-b9b1b2c0d8c2 already deleted. [ 745.655541] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6cdf42d-52d0-472d-a36e-b9b1b2c0d8c2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.071667] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.071667] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.072059] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.072059] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.072192] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.072363] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 7634504a-a16c-44ea-9a82-e8f88bcc65ea not found, creating... [ 746.072676] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.072848] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.072969] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.073247] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.073370] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.073658] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.073816] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.073935] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.074269] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.074412] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.074554] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 7634504a-a16c-44ea-9a82-e8f88bcc65ea is going to be created. [ 746.100797] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.101100] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.101322] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.101760] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.101981] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.102238] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-7634504a-a16c-44ea-9a82-e8f88bcc65ea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.477376] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a in Status: SUCCESS [ 747.477808] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.477808] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.478018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.478244] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.478397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.478469] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.478634] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.478783] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.478868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.479055] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07080bbd-9bb6-4803-a5af-fb39eb3eee3a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.984443] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.987648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.987648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.987648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.987648] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.987648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.987648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.987648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.987648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.987648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.987648] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.987648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.987648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.987648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.987648] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.987648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.987648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.987648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.987648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.988979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.988979] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07080bbd-9bb6-4803-a5af-fb39eb3eee3a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.286020] env[70006]: INFO networking_nsxv3.common.synchronization [None req-1da69557-79d7-42aa-a18a-174a7d1c799b None None] Enqueued Resource ID: e26f4456-cf04-4f02-9e88-5e760eaf1b37 with Priority: HIGHEST for action port [ 748.286298] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e26f4456-cf04-4f02-9e88-5e760eaf1b37 with Priority: HIGHEST for action port [ 748.286986] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-e26f4456-cf04-4f02-9e88-5e760eaf1b37 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.288447] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e26f4456-cf04-4f02-9e88-5e760eaf1b37" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.288509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e26f4456-cf04-4f02-9e88-5e760eaf1b37" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.288820] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e26f4456-cf04-4f02-9e88-5e760eaf1b37" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.288910] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e26f4456-cf04-4f02-9e88-5e760eaf1b37',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.338880] env[70006]: INFO networking_nsxv3.common.synchronization [req-ac494991-daa2-4135-b225-7e41193ada96 req-26625a59-cbbc-4a91-a4a1-ef8caad01be6 tempest-ServerExternalEventsTest-1174324192 tempest-ServerExternalEventsTest-1174324192-project-member] Enqueued Resource ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f with Priority: HIGHEST for action security_group_members [ 748.339579] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f with Priority: HIGHEST for action security_group_members [ 748.340018] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.340255] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.340519] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.340519] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.340720] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.340835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.340880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.341581] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.341697] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.341800] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6541dc4e-5278-42ae-bed3-8ae1f828bb0f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.415060] env[70006]: INFO networking_nsxv3.common.synchronization [req-e6407ee1-70d5-4c39-b821-7b1e64022e29 req-dd87caa3-33fe-4e10-9757-6dca661ba6dd service nova] Enqueued Resource ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 with Priority: HIGHEST for action security_group_rules [ 748.415255] env[70006]: INFO networking_nsxv3.common.synchronization [req-e6407ee1-70d5-4c39-b821-7b1e64022e29 req-dd87caa3-33fe-4e10-9757-6dca661ba6dd service nova] Enqueued Resource ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 with Priority: HIGHEST for action security_group_members [ 748.415395] env[70006]: INFO networking_nsxv3.common.synchronization [req-e6407ee1-70d5-4c39-b821-7b1e64022e29 req-dd87caa3-33fe-4e10-9757-6dca661ba6dd service nova] Enqueued Resource ID: 7634504a-a16c-44ea-9a82-e8f88bcc65ea with Priority: HIGHEST for action port [ 748.419876] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 with Priority: HIGHEST for action security_group_rules [ 748.419876] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 with Priority: HIGHEST for action security_group_members [ 748.419876] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7634504a-a16c-44ea-9a82-e8f88bcc65ea with Priority: HIGHEST for action port [ 748.420629] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.422136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.422136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.422136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.422136] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('caa33f7e-8d3a-4a22-985b-0a592f9b03a1',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.424328] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.424426] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.424488] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.425805] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.425805] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.425805] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.425805] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.425805] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.425805] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.427707] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('caa33f7e-8d3a-4a22-985b-0a592f9b03a1',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.427707] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-7634504a-a16c-44ea-9a82-e8f88bcc65ea taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.427707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7634504a-a16c-44ea-9a82-e8f88bcc65ea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.427707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7634504a-a16c-44ea-9a82-e8f88bcc65ea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.427707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7634504a-a16c-44ea-9a82-e8f88bcc65ea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.427707] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7634504a-a16c-44ea-9a82-e8f88bcc65ea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.493797] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07080bbd-9bb6-4803-a5af-fb39eb3eee3a: rpc.has_security_group_logging(os_id): False [ 748.515173] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.515173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.515173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.515173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.515173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.515173] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.515173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.515173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.515173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.515173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.515173] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.515173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.515173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.515173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.515173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.515729] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.515729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.515729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.515729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.515729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.515729] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a is going to be created. [ 748.580312] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.580502] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.580502] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.581649] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.581649] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.596970] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a in Status: IN_PROGRESS for 2s [ 748.702048] env[70006]: INFO networking_nsxv3.common.synchronization [req-c8419cb7-66bb-4c2c-a2d6-fdf8fe07dfbe req-b428a279-5511-4f9e-bccf-b9ccabc1fd42 tempest-DeleteServersTestJSON-472565240 tempest-DeleteServersTestJSON-472565240-project-member] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 748.702853] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 748.703864] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.703864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.703864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.703864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.704209] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.704209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.704209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.704368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.704416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.704513] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.791432] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e26f4456-cf04-4f02-9e88-5e760eaf1b37 [ 748.792787] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.792787] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.792787] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.792787] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.792787] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.792787] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e26f4456-cf04-4f02-9e88-5e760eaf1b37 already deleted. [ 748.792787] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e26f4456-cf04-4f02-9e88-5e760eaf1b37" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.845127] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.845321] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.845421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.846996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.846996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.846996] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.846996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.846996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.846996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.846996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.847306] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f is going to be updated. [ 748.885773] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.885773] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.885773] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.886096] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.886248] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.900808] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f in Status: IN_PROGRESS for 2s [ 748.932027] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.932027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.932027] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('caa33f7e-8d3a-4a22-985b-0a592f9b03a1',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.932542] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7634504a-a16c-44ea-9a82-e8f88bcc65ea with status ACTIVE [ 748.932763] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.932913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.932984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.934799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.934910] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.935143] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.935272] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.935336] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.935515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.935594] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.935787] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.936213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.936338] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.936510] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.936589] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.936681] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7634504a-a16c-44ea-9a82-e8f88bcc65ea is going to be updated. [ 748.974330] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.974330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.974330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.974330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.974330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.974330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7634504a-a16c-44ea-9a82-e8f88bcc65ea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.210699] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.211866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.211866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.211866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.211866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.211866] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.211866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.211866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.212277] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.212277] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.212277] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 749.263038] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.263038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.263038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.263038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.263038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.274529] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 749.443830] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('caa33f7e-8d3a-4a22-985b-0a592f9b03a1',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.586403] env[70006]: INFO networking_nsxv3.common.synchronization [None req-c530909f-54d3-4dfc-acf6-1abdd3bbdebe None None] Enqueued Resource ID: 31df46ef-0b9d-4e65-bc66-a220901e764e with Priority: HIGHEST for action port [ 749.587896] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31df46ef-0b9d-4e65-bc66-a220901e764e with Priority: HIGHEST for action port [ 749.588333] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-31df46ef-0b9d-4e65-bc66-a220901e764e taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.589468] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31df46ef-0b9d-4e65-bc66-a220901e764e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.589468] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31df46ef-0b9d-4e65-bc66-a220901e764e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.589468] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31df46ef-0b9d-4e65-bc66-a220901e764e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.589468] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31df46ef-0b9d-4e65-bc66-a220901e764e',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.947434] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.947434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.947434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.947434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.947434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.947434] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 is going to be created. [ 749.979403] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.982021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.982021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.982021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.982021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.998786] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 in Status: UNINITIALIZED for 2s [ 750.091459] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31df46ef-0b9d-4e65-bc66-a220901e764e [ 750.091712] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.091856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.091927] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.092166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.092263] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.092360] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31df46ef-0b9d-4e65-bc66-a220901e764e already deleted. [ 750.092443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31df46ef-0b9d-4e65-bc66-a220901e764e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.523631] env[70006]: INFO networking_nsxv3.common.synchronization [req-292c5b2d-d377-4f51-8fc3-0e9a49b629e5 req-85acf127-b7ae-47ff-8b2d-cdbfe0c3525c tempest-ServersAdminNegativeTestJSON-1617245453 tempest-ServersAdminNegativeTestJSON-1617245453-project-member] Enqueued Resource ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 with Priority: HIGHEST for action security_group_members [ 750.524761] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 with Priority: HIGHEST for action security_group_members [ 750.525180] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4e3fb3-c949-45ee-b225-af03d5526168 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.525323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.525385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.525712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.525892] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.526611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.526611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.526611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.526611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.526611] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a4e3fb3-c949-45ee-b225-af03d5526168',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.612932] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a in Status: SUCCESS [ 750.612932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.912938] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f in Status: SUCCESS [ 750.912938] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f deletion is rescheduled due to dependency. [ 750.912938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.029068] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.029498] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.029719] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.030106] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.030346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.030661] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.030892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.031099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.034865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.034865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.034865] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 already deleted. [ 751.034865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.287214] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 751.287541] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 deletion is rescheduled due to dependency. [ 751.287877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.915039] env[70006]: INFO networking_nsxv3.common.synchronization [req-eccf7839-f656-456f-a344-028e178215be req-27c1e7ac-8b91-40a8-8771-201edede5edb tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: cefeff63-e154-425d-8ffe-56cc092db146 with Priority: HIGHEST for action security_group_members [ 751.916204] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cefeff63-e154-425d-8ffe-56cc092db146 with Priority: HIGHEST for action security_group_members [ 751.918130] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cefeff63-e154-425d-8ffe-56cc092db146 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.918130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.918130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.918130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.918130] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.918130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.918130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.918130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.918130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.918920] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cefeff63-e154-425d-8ffe-56cc092db146',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.013491] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 in Status: SUCCESS [ 752.013767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.013953] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.014230] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.014439] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.014570] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.014646] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.014835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.014942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.015044] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.015139] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('caa33f7e-8d3a-4a22-985b-0a592f9b03a1',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.201725] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.202100] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.202256] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.202613] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.202982] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.203276] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.203460] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.203964] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.204194] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.204415] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.204568] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.204766] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.204887] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.204887] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.205033] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.205207] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.232131] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.232131] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 752.232131] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.232131] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.232131] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-5708c0e5-6147-4b18-b294-885738a29578 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.232131] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-5708c0e5-6147-4b18-b294-885738a29578" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.232131] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-5708c0e5-6147-4b18-b294-885738a29578" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.232131] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-5708c0e5-6147-4b18-b294-885738a29578" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.232131] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5708c0e5-6147-4b18-b294-885738a29578',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.421609] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.421792] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.422240] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.422240] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.422331] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.422500] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.422723] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.422723] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.422968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.423033] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.423280] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cefeff63-e154-425d-8ffe-56cc092db146 already deleted. [ 752.423280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.503909] env[70006]: INFO networking_nsxv3.common.synchronization [None req-1aadbd00-4c02-494d-a46e-2cd41fae1ed3 None None] Enqueued Resource ID: 60c2ab11-c879-4e4e-b74b-af3bccfd89fa with Priority: HIGHEST for action port [ 752.504541] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c2ab11-c879-4e4e-b74b-af3bccfd89fa with Priority: HIGHEST for action port [ 752.505092] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-60c2ab11-c879-4e4e-b74b-af3bccfd89fa taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.506313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60c2ab11-c879-4e4e-b74b-af3bccfd89fa" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.506313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60c2ab11-c879-4e4e-b74b-af3bccfd89fa" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.506313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60c2ab11-c879-4e4e-b74b-af3bccfd89fa" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.506313] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60c2ab11-c879-4e4e-b74b-af3bccfd89fa',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.519181] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('caa33f7e-8d3a-4a22-985b-0a592f9b03a1',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.684668] env[70006]: INFO networking_nsxv3.common.synchronization [None req-4b01b07f-bf84-4475-b47c-9ac67e22af30 None None] Enqueued Resource ID: 4ac9b850-d8f1-4d3b-9fe9-5f8244d8078a with Priority: HIGHEST for action port [ 752.685500] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ac9b850-d8f1-4d3b-9fe9-5f8244d8078a with Priority: HIGHEST for action port [ 752.685606] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ac9b850-d8f1-4d3b-9fe9-5f8244d8078a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.685715] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ac9b850-d8f1-4d3b-9fe9-5f8244d8078a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.685779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ac9b850-d8f1-4d3b-9fe9-5f8244d8078a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.686241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ac9b850-d8f1-4d3b-9fe9-5f8244d8078a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.686429] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ac9b850-d8f1-4d3b-9fe9-5f8244d8078a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.741890] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.742207] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.742288] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.742597] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.742755] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.742915] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 5708c0e5-6147-4b18-b294-885738a29578 not found, creating... [ 752.744092] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.744327] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.744491] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.744738] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.744897] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.745377] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.745486] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.745588] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.745864] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.746015] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.746165] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 5708c0e5-6147-4b18-b294-885738a29578 is going to be created. [ 752.775205] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.775205] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.775205] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.775205] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.775205] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.775205] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-5708c0e5-6147-4b18-b294-885738a29578" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.008920] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60c2ab11-c879-4e4e-b74b-af3bccfd89fa [ 753.008920] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.008920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.008920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.008920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.009482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.009482] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60c2ab11-c879-4e4e-b74b-af3bccfd89fa already deleted. [ 753.009482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60c2ab11-c879-4e4e-b74b-af3bccfd89fa" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.023034] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for caa33f7e-8d3a-4a22-985b-0a592f9b03a1: rpc.has_security_group_logging(os_id): False [ 753.046802] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.046802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.046802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.046802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.046802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.046802] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.046802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.046802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.046802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.049097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.049097] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 is going to be created. [ 753.072210] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.072537] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.072655] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.075347] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.075702] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.076033] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.076033] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.076558] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.076558] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.076764] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.076850] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.076930] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.077062] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.077148] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.077249] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.077649] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.103870] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.104065] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 753.104199] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.104390] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.105050] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-3ddab8d9-c5bd-4de2-994d-621e5e86cc88 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.105210] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-3ddab8d9-c5bd-4de2-994d-621e5e86cc88" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.105534] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-3ddab8d9-c5bd-4de2-994d-621e5e86cc88" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.105887] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-3ddab8d9-c5bd-4de2-994d-621e5e86cc88" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.105887] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ddab8d9-c5bd-4de2-994d-621e5e86cc88',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.144986] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.144986] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.144986] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.144986] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.144986] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.163457] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 in Status: IN_PROGRESS for 2s [ 753.190979] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ac9b850-d8f1-4d3b-9fe9-5f8244d8078a [ 753.190979] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.190979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.190979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.190979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.190979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.190979] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ac9b850-d8f1-4d3b-9fe9-5f8244d8078a already deleted. [ 753.190979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ac9b850-d8f1-4d3b-9fe9-5f8244d8078a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.612334] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.612334] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.612334] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.614552] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.614762] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.614937] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 3ddab8d9-c5bd-4de2-994d-621e5e86cc88 not found, creating... [ 753.617271] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.617271] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.617271] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.617593] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.617715] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.618385] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.618649] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.618820] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.619225] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.619454] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.619711] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 3ddab8d9-c5bd-4de2-994d-621e5e86cc88 is going to be created. [ 753.657314] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.657314] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.657314] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.657580] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.657844] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.658166] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-3ddab8d9-c5bd-4de2-994d-621e5e86cc88" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.354071] env[70006]: INFO networking_nsxv3.common.synchronization [req-292c5b2d-d377-4f51-8fc3-0e9a49b629e5 req-0d9cdf13-b969-4ae6-a8a4-030e9dfbc1c0 service nova] Enqueued Resource ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 with Priority: HIGHEST for action security_group_rules [ 754.354473] env[70006]: INFO networking_nsxv3.common.synchronization [req-292c5b2d-d377-4f51-8fc3-0e9a49b629e5 req-0d9cdf13-b969-4ae6-a8a4-030e9dfbc1c0 service nova] Enqueued Resource ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 with Priority: HIGHEST for action security_group_members [ 754.354853] env[70006]: INFO networking_nsxv3.common.synchronization [req-292c5b2d-d377-4f51-8fc3-0e9a49b629e5 req-0d9cdf13-b969-4ae6-a8a4-030e9dfbc1c0 service nova] Enqueued Resource ID: 5708c0e5-6147-4b18-b294-885738a29578 with Priority: HIGHEST for action port [ 754.356196] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 with Priority: HIGHEST for action security_group_rules [ 754.356196] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 with Priority: HIGHEST for action security_group_members [ 754.356196] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5708c0e5-6147-4b18-b294-885738a29578 with Priority: HIGHEST for action port [ 754.356196] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a4e3fb3-c949-45ee-b225-af03d5526168 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.356577] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.356577] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.356917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.356917] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a4e3fb3-c949-45ee-b225-af03d5526168',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.358953] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4e3fb3-c949-45ee-b225-af03d5526168 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.359135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.359203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.359450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.359880] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.360018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.360141] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.360495] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.360627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.360734] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a4e3fb3-c949-45ee-b225-af03d5526168',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.362655] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-5708c0e5-6147-4b18-b294-885738a29578 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.362655] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5708c0e5-6147-4b18-b294-885738a29578" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.362655] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5708c0e5-6147-4b18-b294-885738a29578" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.362655] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5708c0e5-6147-4b18-b294-885738a29578" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.362655] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5708c0e5-6147-4b18-b294-885738a29578',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.638279] env[70006]: INFO networking_nsxv3.common.synchronization [None req-701840bc-19b8-485e-8394-b2adfdec058e None None] Enqueued Resource ID: ddfd81b5-3a5b-4746-9368-92fb9ad3da02 with Priority: HIGHEST for action port [ 754.639223] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddfd81b5-3a5b-4746-9368-92fb9ad3da02 with Priority: HIGHEST for action port [ 754.639688] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddfd81b5-3a5b-4746-9368-92fb9ad3da02 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.640025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddfd81b5-3a5b-4746-9368-92fb9ad3da02" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.640198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddfd81b5-3a5b-4746-9368-92fb9ad3da02" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.640553] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddfd81b5-3a5b-4746-9368-92fb9ad3da02" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.640745] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddfd81b5-3a5b-4746-9368-92fb9ad3da02',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.857594] env[70006]: INFO networking_nsxv3.common.synchronization [req-eccf7839-f656-456f-a344-028e178215be req-1cdbf634-a7f5-4b89-9bcc-46094c7c2f08 service nova] Enqueued Resource ID: cefeff63-e154-425d-8ffe-56cc092db146 with Priority: HIGHEST for action security_group_rules [ 754.857937] env[70006]: INFO networking_nsxv3.common.synchronization [req-eccf7839-f656-456f-a344-028e178215be req-1cdbf634-a7f5-4b89-9bcc-46094c7c2f08 service nova] Enqueued Resource ID: cefeff63-e154-425d-8ffe-56cc092db146 with Priority: HIGHEST for action security_group_members [ 754.858219] env[70006]: INFO networking_nsxv3.common.synchronization [req-eccf7839-f656-456f-a344-028e178215be req-1cdbf634-a7f5-4b89-9bcc-46094c7c2f08 service nova] Enqueued Resource ID: 3ddab8d9-c5bd-4de2-994d-621e5e86cc88 with Priority: HIGHEST for action port [ 754.861648] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cefeff63-e154-425d-8ffe-56cc092db146 with Priority: HIGHEST for action security_group_rules [ 754.865022] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cefeff63-e154-425d-8ffe-56cc092db146 with Priority: HIGHEST for action security_group_members [ 754.865022] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ddab8d9-c5bd-4de2-994d-621e5e86cc88 with Priority: HIGHEST for action port [ 754.865022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cefeff63-e154-425d-8ffe-56cc092db146 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.865022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.865022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.865022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.865022] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cefeff63-e154-425d-8ffe-56cc092db146',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.865022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cefeff63-e154-425d-8ffe-56cc092db146 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.865022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.865022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.865022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.865022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.865022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.865022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.865022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.865022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.865022] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cefeff63-e154-425d-8ffe-56cc092db146',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.867694] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ddab8d9-c5bd-4de2-994d-621e5e86cc88 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.870333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ddab8d9-c5bd-4de2-994d-621e5e86cc88" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.870333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ddab8d9-c5bd-4de2-994d-621e5e86cc88" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.870333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ddab8d9-c5bd-4de2-994d-621e5e86cc88" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.870333] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ddab8d9-c5bd-4de2-994d-621e5e86cc88',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.870333] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4e3fb3-c949-45ee-b225-af03d5526168 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.870333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.870333] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5708c0e5-6147-4b18-b294-885738a29578 with status ACTIVE [ 754.870333] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.870333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.871403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.871687] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.871895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.872175] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.872415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.872575] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.872812] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.872990] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.873271] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.873493] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.873647] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.873895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.874084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.874258] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5708c0e5-6147-4b18-b294-885738a29578 is going to be updated. [ 754.875654] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a4e3fb3-c949-45ee-b225-af03d5526168',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.900040] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.900040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.900040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.900040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.900040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.900040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5708c0e5-6147-4b18-b294-885738a29578" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.972916] env[70006]: INFO networking_nsxv3.common.synchronization [None req-4879b0ae-219b-44a8-89eb-ad63c48c29c2 None None] Enqueued Resource ID: 6d3ef2e1-dd63-4922-be33-daf1ffc201f0 with Priority: HIGHEST for action port [ 754.972916] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3ef2e1-dd63-4922-be33-daf1ffc201f0 with Priority: HIGHEST for action port [ 754.973480] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d3ef2e1-dd63-4922-be33-daf1ffc201f0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.975247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d3ef2e1-dd63-4922-be33-daf1ffc201f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.975247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d3ef2e1-dd63-4922-be33-daf1ffc201f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.975582] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d3ef2e1-dd63-4922-be33-daf1ffc201f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.975582] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d3ef2e1-dd63-4922-be33-daf1ffc201f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.145654] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddfd81b5-3a5b-4746-9368-92fb9ad3da02 [ 755.145654] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.145654] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.145654] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.145654] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.145654] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.145654] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddfd81b5-3a5b-4746-9368-92fb9ad3da02 already deleted. [ 755.145654] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddfd81b5-3a5b-4746-9368-92fb9ad3da02" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.179071] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 in Status: SUCCESS [ 755.179071] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.370774] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cefeff63-e154-425d-8ffe-56cc092db146 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.372078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.380902] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ddab8d9-c5bd-4de2-994d-621e5e86cc88 with status ACTIVE [ 755.380902] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.380902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.380902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.384027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.384027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.384027] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.384027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.384027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.384027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.384027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.384027] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.384027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.384027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.384027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.384027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.384851] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ddab8d9-c5bd-4de2-994d-621e5e86cc88 is going to be updated. [ 755.388587] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cefeff63-e154-425d-8ffe-56cc092db146',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.388587] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a4e3fb3-c949-45ee-b225-af03d5526168',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.422696] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.422696] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.422941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.422984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.424093] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.424093] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ddab8d9-c5bd-4de2-994d-621e5e86cc88" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.478147] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d3ef2e1-dd63-4922-be33-daf1ffc201f0 [ 755.480408] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.480408] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.480408] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.480408] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.480408] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.480408] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d3ef2e1-dd63-4922-be33-daf1ffc201f0 already deleted. [ 755.480408] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d3ef2e1-dd63-4922-be33-daf1ffc201f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.895089] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cefeff63-e154-425d-8ffe-56cc092db146',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.895089] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.895089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.895089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.895089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.895089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.895089] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 is going to be created. [ 755.922019] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.922019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.922019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.922019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.922019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.931385] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 in Status: UNINITIALIZED for 2s [ 756.087187] env[70006]: INFO networking_nsxv3.common.synchronization [None req-4de6cfae-b47c-4152-bc91-5a075fadc60c None None] Enqueued Resource ID: 92778b47-b02c-4686-b150-3683a3f656bc with Priority: HIGHEST for action port [ 756.087645] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92778b47-b02c-4686-b150-3683a3f656bc with Priority: HIGHEST for action port [ 756.088076] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-92778b47-b02c-4686-b150-3683a3f656bc taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.088207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92778b47-b02c-4686-b150-3683a3f656bc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.088273] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92778b47-b02c-4686-b150-3683a3f656bc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.088963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92778b47-b02c-4686-b150-3683a3f656bc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.089652] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92778b47-b02c-4686-b150-3683a3f656bc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.396115] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.396456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.396456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.396681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.396826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.396915] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cefeff63-e154-425d-8ffe-56cc092db146 is going to be created. [ 756.426182] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.427435] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.427586] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.427819] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.428247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.440942] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cefeff63-e154-425d-8ffe-56cc092db146 in Status: UNINITIALIZED for 2s [ 756.592951] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92778b47-b02c-4686-b150-3683a3f656bc [ 756.592951] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.592951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.592951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.593247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.593422] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.593547] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92778b47-b02c-4686-b150-3683a3f656bc already deleted. [ 756.593665] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92778b47-b02c-4686-b150-3683a3f656bc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.049342] env[70006]: INFO networking_nsxv3.common.synchronization [None req-c2550d82-494e-4454-8001-ca13d3dd14c6 None None] Enqueued Resource ID: 308dea5e-6863-41e8-8e5c-95cd648acd2b with Priority: HIGHEST for action port [ 757.049342] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 308dea5e-6863-41e8-8e5c-95cd648acd2b with Priority: HIGHEST for action port [ 757.049513] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-308dea5e-6863-41e8-8e5c-95cd648acd2b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.049615] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-308dea5e-6863-41e8-8e5c-95cd648acd2b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.049689] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-308dea5e-6863-41e8-8e5c-95cd648acd2b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.052519] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-308dea5e-6863-41e8-8e5c-95cd648acd2b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.054171] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('308dea5e-6863-41e8-8e5c-95cd648acd2b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.556268] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 308dea5e-6863-41e8-8e5c-95cd648acd2b [ 757.556637] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.557038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.557038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.557245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.557245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.557342] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:308dea5e-6863-41e8-8e5c-95cd648acd2b already deleted. [ 757.557436] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-308dea5e-6863-41e8-8e5c-95cd648acd2b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.943373] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 in Status: SUCCESS [ 757.943641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.943896] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.943982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.944186] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.944315] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.944413] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.944524] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.944610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.944695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.944785] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a4e3fb3-c949-45ee-b225-af03d5526168',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.446933] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4e3fb3-c949-45ee-b225-af03d5526168 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.447126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.447178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.447402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.447569] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.447670] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.447731] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.447885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.449013] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.449013] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.449013] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4e3fb3-c949-45ee-b225-af03d5526168 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.449013] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.449013] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.449013] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.449013] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.449013] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.449013] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.449427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.449427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.449427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.449427] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a4e3fb3-c949-45ee-b225-af03d5526168',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.452265] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cefeff63-e154-425d-8ffe-56cc092db146 in Status: SUCCESS [ 758.452448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.454015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.454015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.454015] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.454015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.454015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.454015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.454015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.454015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.454015] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cefeff63-e154-425d-8ffe-56cc092db146',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.951849] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a4e3fb3-c949-45ee-b225-af03d5526168: rpc.has_security_group_logging(os_id): False [ 758.955949] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cefeff63-e154-425d-8ffe-56cc092db146',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.984034] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.984034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.984034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.984034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.984034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.984034] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.984034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.984034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.984034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.984034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.984034] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.984034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.984034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.984034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.984034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.985087] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.985087] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.985087] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.985087] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.985087] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.985087] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 is going to be created. [ 759.027166] env[70006]: INFO networking_nsxv3.common.synchronization [None req-b08c4372-5eaf-4402-a99f-7cd59d983207 None None] Enqueued Resource ID: bb5cd636-dd61-4a7c-901d-f766f3304276 with Priority: HIGHEST for action port [ 759.027840] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb5cd636-dd61-4a7c-901d-f766f3304276 with Priority: HIGHEST for action port [ 759.028550] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb5cd636-dd61-4a7c-901d-f766f3304276 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.028550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb5cd636-dd61-4a7c-901d-f766f3304276" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.028550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb5cd636-dd61-4a7c-901d-f766f3304276" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.028931] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb5cd636-dd61-4a7c-901d-f766f3304276" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.028931] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb5cd636-dd61-4a7c-901d-f766f3304276',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.047171] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.047171] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.047171] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.047886] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.047886] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.060467] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 in Status: IN_PROGRESS for 2s [ 759.468998] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cefeff63-e154-425d-8ffe-56cc092db146: rpc.has_security_group_logging(os_id): False [ 759.492267] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.492267] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.492267] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.492267] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.492267] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.492267] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.492267] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.492267] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.492267] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.492267] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.492267] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cefeff63-e154-425d-8ffe-56cc092db146 is going to be created. [ 759.530931] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb5cd636-dd61-4a7c-901d-f766f3304276 [ 759.531467] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.531676] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.531746] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.531979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.532207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.532360] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb5cd636-dd61-4a7c-901d-f766f3304276 already deleted. [ 759.532473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb5cd636-dd61-4a7c-901d-f766f3304276" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.569420] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.569603] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.569704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.570051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.570401] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.606193] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cefeff63-e154-425d-8ffe-56cc092db146 in Status: IN_PROGRESS for 2s [ 760.321486] env[70006]: INFO networking_nsxv3.common.synchronization [req-6fc4a87b-b8b3-4d59-a73a-0734feca339d req-12e9ecf5-0e9e-42eb-9f11-84c0c9928c03 tempest-ServersTestJSON-1431904245 tempest-ServersTestJSON-1431904245-project-member] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 760.321486] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 760.322593] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.323579] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.323579] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.323579] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.323579] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.324467] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.324726] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.325059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.325640] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.325640] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.592144] env[70006]: INFO networking_nsxv3.common.synchronization [req-8c799835-18d3-4b31-8dc1-ac83f3c12f5d req-14e821de-e9ad-4436-a913-c4f406b0173c tempest-ImagesTestJSON-196229908 tempest-ImagesTestJSON-196229908-project-member] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 760.598019] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 760.598019] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.598019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.598019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.598019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.598019] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.598019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.598019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.598019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.598019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.598019] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.828435] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.828616] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.828711] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.829295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.829295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.829464] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.829651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.829733] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.829903] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.829983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.830087] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f already deleted. [ 760.830175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.004231] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.004457] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.004592] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.004958] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.005306] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.005500] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.005616] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.005843] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.005992] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.006343] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.006457] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.006562] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.006668] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.006837] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.006917] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.007074] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.030869] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.031070] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 761.032486] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.033147] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.033717] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-3f3abd39-894f-40ce-bea2-c815ae8ed3c3 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.033883] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-3f3abd39-894f-40ce-bea2-c815ae8ed3c3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.033883] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-3f3abd39-894f-40ce-bea2-c815ae8ed3c3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.034261] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-3f3abd39-894f-40ce-bea2-c815ae8ed3c3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.034419] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f3abd39-894f-40ce-bea2-c815ae8ed3c3',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.074327] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 in Status: SUCCESS [ 761.074580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.104619] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.104619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.104619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.104619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.104923] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.104923] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.105059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.105059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.105359] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.105359] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.105359] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be updated. [ 761.153497] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.153684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.153786] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.154093] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.154307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.170511] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: IN_PROGRESS for 2s [ 761.537288] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.537693] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.537761] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.538030] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.538199] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.538455] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 3f3abd39-894f-40ce-bea2-c815ae8ed3c3 not found, creating... [ 761.538838] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.539102] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.539242] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.539789] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.539789] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.544489] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.544728] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.544856] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.545193] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.545364] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.546219] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 3f3abd39-894f-40ce-bea2-c815ae8ed3c3 is going to be created. [ 761.568649] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.568649] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.568649] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.568878] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.570039] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.570039] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-3f3abd39-894f-40ce-bea2-c815ae8ed3c3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.621673] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cefeff63-e154-425d-8ffe-56cc092db146 in Status: SUCCESS [ 761.622049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.743232] env[70006]: INFO networking_nsxv3.common.synchronization [req-6fc4a87b-b8b3-4d59-a73a-0734feca339d req-d44aeac8-98cb-45f7-8bb1-a7a45d6c9fbd service nova] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_rules [ 762.744289] env[70006]: INFO networking_nsxv3.common.synchronization [req-6fc4a87b-b8b3-4d59-a73a-0734feca339d req-d44aeac8-98cb-45f7-8bb1-a7a45d6c9fbd service nova] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 762.744484] env[70006]: INFO networking_nsxv3.common.synchronization [req-6fc4a87b-b8b3-4d59-a73a-0734feca339d req-d44aeac8-98cb-45f7-8bb1-a7a45d6c9fbd service nova] Enqueued Resource ID: 3f3abd39-894f-40ce-bea2-c815ae8ed3c3 with Priority: HIGHEST for action port [ 762.745380] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_rules [ 762.745380] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 762.745380] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f3abd39-894f-40ce-bea2-c815ae8ed3c3 with Priority: HIGHEST for action port [ 762.745703] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.745819] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.745819] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.747043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.747043] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.747043] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.747240] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.747240] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.747365] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.747481] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.748299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.748299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.748299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.748299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.748299] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.752959] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f3abd39-894f-40ce-bea2-c815ae8ed3c3 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.753384] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f3abd39-894f-40ce-bea2-c815ae8ed3c3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.753454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f3abd39-894f-40ce-bea2-c815ae8ed3c3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.753629] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f3abd39-894f-40ce-bea2-c815ae8ed3c3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.753704] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f3abd39-894f-40ce-bea2-c815ae8ed3c3',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.183911] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 763.184173] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 deletion is rescheduled due to dependency. [ 763.184320] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.255177] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.257801] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.257932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.258469] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f3abd39-894f-40ce-bea2-c815ae8ed3c3 with status ACTIVE [ 763.258469] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.258627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.258627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.258862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.258988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.259198] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.259320] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.259392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.259516] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.259595] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.259772] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.259888] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.259973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.266083] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.266213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.266300] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f3abd39-894f-40ce-bea2-c815ae8ed3c3 is going to be updated. [ 763.289173] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.289324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.289393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.289611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.289751] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.289915] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f3abd39-894f-40ce-bea2-c815ae8ed3c3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.758820] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.261710] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.261710] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.262125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.262125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.262202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.262321] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be created. [ 764.293102] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.293598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.294986] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.295510] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.297019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.312382] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: UNINITIALIZED for 2s [ 765.028418] env[70006]: INFO networking_nsxv3.common.synchronization [None req-f3d24598-8855-4313-af42-cad3c8c39250 None None] Enqueued Resource ID: cfaa7a47-d14e-44e6-bca8-318ce27e5af0 with Priority: HIGHEST for action port [ 765.028754] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfaa7a47-d14e-44e6-bca8-318ce27e5af0 with Priority: HIGHEST for action port [ 765.029415] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfaa7a47-d14e-44e6-bca8-318ce27e5af0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.029573] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfaa7a47-d14e-44e6-bca8-318ce27e5af0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.029651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfaa7a47-d14e-44e6-bca8-318ce27e5af0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.030730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfaa7a47-d14e-44e6-bca8-318ce27e5af0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.030925] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfaa7a47-d14e-44e6-bca8-318ce27e5af0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.532810] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfaa7a47-d14e-44e6-bca8-318ce27e5af0 [ 765.533090] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.533232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.534664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.534664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.534664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.534664] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfaa7a47-d14e-44e6-bca8-318ce27e5af0 already deleted. [ 765.534664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfaa7a47-d14e-44e6-bca8-318ce27e5af0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.324677] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 766.324993] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.325089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.325788] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.325788] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.325788] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.325788] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.326047] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.326047] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.326047] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.326148] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.379201] env[70006]: INFO networking_nsxv3.common.synchronization [req-940e4ffd-d7d9-4f86-becc-fc9648184986 req-3525132a-3fcd-42c8-b2c7-102bb6b1753c tempest-AttachVolumeNegativeTest-242855104 tempest-AttachVolumeNegativeTest-242855104-project-member] Enqueued Resource ID: d4596cda-f889-4b1b-8e98-7effb27170e9 with Priority: HIGHEST for action security_group_members [ 766.383021] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4596cda-f889-4b1b-8e98-7effb27170e9 with Priority: HIGHEST for action security_group_members [ 766.383021] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4596cda-f889-4b1b-8e98-7effb27170e9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.383021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.383021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.383021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.383021] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.383021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.383021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.383495] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.383495] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.383636] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4596cda-f889-4b1b-8e98-7effb27170e9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.835477] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.835477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.835477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.835477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.835477] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.835477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.835477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.835477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.835477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.835477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.835477] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.835477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.835477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.835477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.836443] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.836443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.836443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.836443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.836443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.836443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.836443] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.887167] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.887312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.887388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.887662] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.887881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.887978] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.888099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.888199] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.888378] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.888458] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.888563] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4596cda-f889-4b1b-8e98-7effb27170e9 already deleted. [ 766.888652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.077943] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-297 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.079575] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-297" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.079753] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-297" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.080141] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-297" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.080460] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.080639] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.080760] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.080996] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.081425] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.081684] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.081834] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.081980] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.082131] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.082285] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.082451] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.082682] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.109052] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.109248] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 767.109406] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.109609] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-297" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.111291] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-aab77ffc-40a3-47ea-abe4-1abb8298eba0 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.111291] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-aab77ffc-40a3-47ea-abe4-1abb8298eba0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.111291] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-aab77ffc-40a3-47ea-abe4-1abb8298eba0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.111291] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-aab77ffc-40a3-47ea-abe4-1abb8298eba0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.111291] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aab77ffc-40a3-47ea-abe4-1abb8298eba0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.342186] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b2723f9-b1dc-419e-b339-13aae985829f: rpc.has_security_group_logging(os_id): False [ 767.370341] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.370545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.370683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.370858] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.370979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.371208] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.371358] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.371406] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.371633] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.371719] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.371947] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.372198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.372198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.372343] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.372437] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.372673] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.372779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.372861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.374527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.374756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.374907] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be created. [ 767.448711] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.448711] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.448934] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.449548] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.449548] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.461464] env[70006]: INFO networking_nsxv3.common.synchronization [None req-d09eecf0-bf7c-4a66-bc3a-44f54148c3f5 tempest-ServerActionsTestOtherB-500818960 tempest-ServerActionsTestOtherB-500818960-project-member] Enqueued Resource ID: 3bfcced0-302f-485f-8f97-567dcec9496b with Priority: HIGHEST for action security_group_rules [ 767.462206] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bfcced0-302f-485f-8f97-567dcec9496b with Priority: HIGHEST for action security_group_rules [ 767.463326] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 767.463599] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bfcced0-302f-485f-8f97-567dcec9496b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.463737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bfcced0-302f-485f-8f97-567dcec9496b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.463805] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bfcced0-302f-485f-8f97-567dcec9496b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.464135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bfcced0-302f-485f-8f97-567dcec9496b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.464248] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bfcced0-302f-485f-8f97-567dcec9496b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.619163] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.619429] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.619558] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.619850] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.620031] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.620197] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port aab77ffc-40a3-47ea-abe4-1abb8298eba0 not found, creating... [ 767.620465] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.621427] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.621427] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.621427] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.621427] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.621427] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.621651] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.621651] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.621868] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.622009] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.625468] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: aab77ffc-40a3-47ea-abe4-1abb8298eba0 is going to be created. [ 767.638216] env[70006]: INFO networking_nsxv3.common.synchronization [None req-2269ea3b-2cc3-4139-aa95-bc0d457a42b8 tempest-ServerActionsTestOtherB-500818960 tempest-ServerActionsTestOtherB-500818960-project-member] Enqueued Resource ID: 3bfcced0-302f-485f-8f97-567dcec9496b with Priority: HIGHEST for action security_group_rules [ 767.638216] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bfcced0-302f-485f-8f97-567dcec9496b with Priority: HIGHEST for action security_group_rules [ 767.638216] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bfcced0-302f-485f-8f97-567dcec9496b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.638216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bfcced0-302f-485f-8f97-567dcec9496b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.652616] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.652848] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.652964] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.659646] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.659872] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.660550] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-aab77ffc-40a3-47ea-abe4-1abb8298eba0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.977624] env[70006]: INFO networking_nsxv3.common.synchronization [None req-1be2b43d-428c-4ee6-b85e-de3d438175a8 None None] Enqueued Resource ID: 78e8846e-847e-4142-9e79-a646fc000aa2 with Priority: HIGHEST for action port [ 767.978253] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78e8846e-847e-4142-9e79-a646fc000aa2 with Priority: HIGHEST for action port [ 767.978573] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-78e8846e-847e-4142-9e79-a646fc000aa2 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.978716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78e8846e-847e-4142-9e79-a646fc000aa2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.978785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78e8846e-847e-4142-9e79-a646fc000aa2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.979152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78e8846e-847e-4142-9e79-a646fc000aa2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.979235] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78e8846e-847e-4142-9e79-a646fc000aa2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.992415] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.992415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.992415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.992415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.992415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.992415] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bfcced0-302f-485f-8f97-567dcec9496b already deleted. [ 767.992415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bfcced0-302f-485f-8f97-567dcec9496b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.992415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bfcced0-302f-485f-8f97-567dcec9496b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.992415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bfcced0-302f-485f-8f97-567dcec9496b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.992415] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bfcced0-302f-485f-8f97-567dcec9496b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.487166] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78e8846e-847e-4142-9e79-a646fc000aa2 [ 768.487575] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.487775] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.487881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.488167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.488296] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.488619] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78e8846e-847e-4142-9e79-a646fc000aa2 already deleted. [ 768.488619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78e8846e-847e-4142-9e79-a646fc000aa2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.519199] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.519446] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.519446] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.519625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.519720] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.519821] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bfcced0-302f-485f-8f97-567dcec9496b already deleted. [ 768.519896] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bfcced0-302f-485f-8f97-567dcec9496b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.683670] env[70006]: INFO networking_nsxv3.common.synchronization [req-940e4ffd-d7d9-4f86-becc-fc9648184986 req-7618d0f2-d356-431f-9b27-fed8796e82ac service nova] Enqueued Resource ID: d4596cda-f889-4b1b-8e98-7effb27170e9 with Priority: HIGHEST for action security_group_rules [ 768.683670] env[70006]: INFO networking_nsxv3.common.synchronization [req-940e4ffd-d7d9-4f86-becc-fc9648184986 req-7618d0f2-d356-431f-9b27-fed8796e82ac service nova] Enqueued Resource ID: d4596cda-f889-4b1b-8e98-7effb27170e9 with Priority: HIGHEST for action security_group_members [ 768.683670] env[70006]: INFO networking_nsxv3.common.synchronization [req-940e4ffd-d7d9-4f86-becc-fc9648184986 req-7618d0f2-d356-431f-9b27-fed8796e82ac service nova] Enqueued Resource ID: aab77ffc-40a3-47ea-abe4-1abb8298eba0 with Priority: HIGHEST for action port [ 768.683670] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4596cda-f889-4b1b-8e98-7effb27170e9 with Priority: HIGHEST for action security_group_rules [ 768.683670] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4596cda-f889-4b1b-8e98-7effb27170e9 with Priority: HIGHEST for action security_group_members [ 768.683670] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aab77ffc-40a3-47ea-abe4-1abb8298eba0 with Priority: HIGHEST for action port [ 768.684269] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4596cda-f889-4b1b-8e98-7effb27170e9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.684398] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.684479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.684721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.684807] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4596cda-f889-4b1b-8e98-7effb27170e9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.685987] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4596cda-f889-4b1b-8e98-7effb27170e9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.686126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.686226] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.686597] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.686597] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.686719] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.686843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.687946] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.687946] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.687946] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4596cda-f889-4b1b-8e98-7effb27170e9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.688448] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-aab77ffc-40a3-47ea-abe4-1abb8298eba0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.688593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aab77ffc-40a3-47ea-abe4-1abb8298eba0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.688682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aab77ffc-40a3-47ea-abe4-1abb8298eba0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.688876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aab77ffc-40a3-47ea-abe4-1abb8298eba0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.688987] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aab77ffc-40a3-47ea-abe4-1abb8298eba0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.197131] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4596cda-f889-4b1b-8e98-7effb27170e9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.197131] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.197131] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4596cda-f889-4b1b-8e98-7effb27170e9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.201848] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aab77ffc-40a3-47ea-abe4-1abb8298eba0 with status ACTIVE [ 769.201848] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.201848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.201848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.201848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.201848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.201848] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.201848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.201848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.201848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.201848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.201848] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.201848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.201848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.201848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.201848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.201848] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aab77ffc-40a3-47ea-abe4-1abb8298eba0 is going to be updated. [ 769.227944] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.228182] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.228182] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.228791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.228791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.228791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aab77ffc-40a3-47ea-abe4-1abb8298eba0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.476654] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 769.477744] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.702404] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4596cda-f889-4b1b-8e98-7effb27170e9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.205846] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.206102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.206173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.206467] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.206601] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.206749] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4596cda-f889-4b1b-8e98-7effb27170e9 is going to be created. [ 770.239551] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.239766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.239843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.240155] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.240345] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.259898] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4596cda-f889-4b1b-8e98-7effb27170e9 in Status: UNINITIALIZED for 2s [ 771.421537] env[70006]: INFO networking_nsxv3.common.synchronization [None req-d90c607d-7513-4b22-83ce-14ee52e6882c None None] Enqueued Resource ID: 9640d1b1-606d-414b-a440-6754eee73b66 with Priority: HIGHEST for action port [ 771.423255] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9640d1b1-606d-414b-a440-6754eee73b66 with Priority: HIGHEST for action port [ 771.423255] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-9640d1b1-606d-414b-a440-6754eee73b66 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.423255] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9640d1b1-606d-414b-a440-6754eee73b66" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.423255] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9640d1b1-606d-414b-a440-6754eee73b66" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.423764] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9640d1b1-606d-414b-a440-6754eee73b66" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.423764] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9640d1b1-606d-414b-a440-6754eee73b66',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.929974] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9640d1b1-606d-414b-a440-6754eee73b66 [ 771.930328] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.930472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.930545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.930780] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.930872] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.930958] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9640d1b1-606d-414b-a440-6754eee73b66 already deleted. [ 771.931053] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9640d1b1-606d-414b-a440-6754eee73b66" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.270755] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4596cda-f889-4b1b-8e98-7effb27170e9 in Status: SUCCESS [ 772.271086] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.271675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.271820] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.271998] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.272280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.272354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.272592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.272687] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.272832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.273167] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4596cda-f889-4b1b-8e98-7effb27170e9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.775741] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4596cda-f889-4b1b-8e98-7effb27170e9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.285552] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4596cda-f889-4b1b-8e98-7effb27170e9: rpc.has_security_group_logging(os_id): False [ 773.307962] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.307962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.307962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.311020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.311020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.311020] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.311020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.311020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.311020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.311020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.311020] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4596cda-f889-4b1b-8e98-7effb27170e9 is going to be created. [ 773.382404] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.382698] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.382698] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.382825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.383071] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.398674] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4596cda-f889-4b1b-8e98-7effb27170e9 in Status: IN_PROGRESS for 2s [ 774.554694] env[70006]: INFO networking_nsxv3.common.synchronization [None req-6fbaabb3-e8fd-43e2-90ae-2b11c02d50e9 None None] Enqueued Resource ID: 2a2b37ae-942a-411c-8e94-10b57788929d with Priority: HIGHEST for action port [ 774.557606] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a2b37ae-942a-411c-8e94-10b57788929d with Priority: HIGHEST for action port [ 774.557606] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a2b37ae-942a-411c-8e94-10b57788929d taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.557606] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a2b37ae-942a-411c-8e94-10b57788929d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.557606] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a2b37ae-942a-411c-8e94-10b57788929d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.557606] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a2b37ae-942a-411c-8e94-10b57788929d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.557606] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a2b37ae-942a-411c-8e94-10b57788929d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.061232] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a2b37ae-942a-411c-8e94-10b57788929d [ 775.061232] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.061232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.061232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.061232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.061232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.061232] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a2b37ae-942a-411c-8e94-10b57788929d already deleted. [ 775.061232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a2b37ae-942a-411c-8e94-10b57788929d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.412433] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4596cda-f889-4b1b-8e98-7effb27170e9 in Status: SUCCESS [ 775.412704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.497025] env[70006]: INFO networking_nsxv3.common.synchronization [req-99477257-dfbf-4ed1-836d-3b5dc227829d req-60f5cb9b-9dd8-48ba-95e6-55e4ecda3c6c tempest-DeleteServersAdminTestJSON-1843386794 tempest-DeleteServersAdminTestJSON-1843386794-project-member] Enqueued Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_members [ 775.497025] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_members [ 775.497279] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.497279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.497472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.497755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.497928] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.498071] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.498151] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.498403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.498540] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.498717] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.899780] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.900075] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.900377] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.900663] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.900939] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.901112] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.901236] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.901451] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.901599] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.901808] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.901921] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.902041] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.902154] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.902286] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.902395] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.902526] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.922745] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.922899] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 775.923018] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.923212] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.923691] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.923691] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.923836] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.924260] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.924422] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.002298] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.002499] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.002569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.002796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.002898] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.003109] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.003221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.003285] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.003437] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.003517] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.003612] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 is going to be updated. [ 776.034463] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.034638] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.034733] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.035009] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.035194] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.045367] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 in Status: IN_PROGRESS for 2s [ 776.426762] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.426971] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.427106] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.427376] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.427531] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.427688] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd not found, creating... [ 776.427959] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.428138] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.428258] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.428485] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.428625] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.428902] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.429096] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.429222] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.429431] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.429852] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.429852] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd is going to be created. [ 776.451664] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.451664] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.451664] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.451664] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.451664] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.451664] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.368688] env[70006]: INFO networking_nsxv3.common.synchronization [req-99477257-dfbf-4ed1-836d-3b5dc227829d req-1ea62b41-9bc3-41f2-ac10-b86a24083163 service nova] Enqueued Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_rules [ 777.368688] env[70006]: INFO networking_nsxv3.common.synchronization [req-99477257-dfbf-4ed1-836d-3b5dc227829d req-1ea62b41-9bc3-41f2-ac10-b86a24083163 service nova] Enqueued Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_members [ 777.368688] env[70006]: INFO networking_nsxv3.common.synchronization [req-99477257-dfbf-4ed1-836d-3b5dc227829d req-1ea62b41-9bc3-41f2-ac10-b86a24083163 service nova] Enqueued Resource ID: 49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd with Priority: HIGHEST for action port [ 777.368688] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_rules [ 777.368688] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_members [ 777.368688] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd with Priority: HIGHEST for action port [ 777.368688] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.368688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.368688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.370640] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.370640] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.373286] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.373286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.373286] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.373286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.373286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.373286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.373286] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.875266] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.875266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.875438] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd with status ACTIVE [ 777.875612] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.875772] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.875772] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.876258] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.876258] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.876258] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.876394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.876394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.876545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.876614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.877500] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.877500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.877500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.877500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.877500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.877500] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd is going to be updated. [ 777.901668] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.901900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.903244] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.903920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.903920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.903920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49f610ba-b8a0-4bd6-b0b9-3f15b2635bcd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.058474] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 in Status: SUCCESS [ 778.058663] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 deletion is rescheduled due to dependency. [ 778.058838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.058950] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.059268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.059476] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.059600] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.059670] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.059829] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.059917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.060031] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.222601] env[70006]: INFO networking_nsxv3.common.synchronization [req-f8286511-e563-4209-8657-5544a6a46b65 req-3f6d4e45-ecb3-4cb4-9b3c-be168b75c6ec tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 778.223298] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 778.223559] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.223682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.223750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.224060] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.224236] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.224307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.224333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.224497] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.224583] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.225454] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.562851] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.712399] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-671 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.712484] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-671" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.712557] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-671" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.712858] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-671" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.713225] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.713394] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.714045] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.714347] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.714457] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.714653] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 778.715028] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 778.715176] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 778.715310] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 778.715426] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 778.715533] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 778.715662] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 778.730248] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.730416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.730488] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.730765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.730867] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.731084] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.731194] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.731262] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.731420] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.731499] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.731584] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 already deleted. [ 778.731668] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.735814] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 778.736009] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 778.736156] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 778.736315] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-671" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.736602] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-9e2b8cbf-ea68-4961-ae17-64f6753e3974 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.736779] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.736932] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.737256] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.737405] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2b8cbf-ea68-4961-ae17-64f6753e3974',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.067406] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.240670] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.240670] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.240777] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.241037] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.241191] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.241371] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 9e2b8cbf-ea68-4961-ae17-64f6753e3974 not found, creating... [ 779.241667] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.241888] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.242036] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.242275] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.242445] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.242846] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.243036] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.243165] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.244042] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.244042] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.244042] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 9e2b8cbf-ea68-4961-ae17-64f6753e3974 is going to be created. [ 779.266311] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.266681] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.266853] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.267175] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.267570] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.267847] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.570606] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.570898] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.570898] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.571161] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.571285] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.571406] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 is going to be updated. [ 779.605057] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.605220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.605291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.605518] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.605671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.615759] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 in Status: IN_PROGRESS for 2s [ 780.196340] env[70006]: INFO networking_nsxv3.common.synchronization [req-f8286511-e563-4209-8657-5544a6a46b65 req-d07f3337-0f64-49cb-a9d7-28f93fe0711c service nova] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_rules [ 780.196638] env[70006]: INFO networking_nsxv3.common.synchronization [req-f8286511-e563-4209-8657-5544a6a46b65 req-d07f3337-0f64-49cb-a9d7-28f93fe0711c service nova] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 780.196859] env[70006]: INFO networking_nsxv3.common.synchronization [req-f8286511-e563-4209-8657-5544a6a46b65 req-d07f3337-0f64-49cb-a9d7-28f93fe0711c service nova] Enqueued Resource ID: 9e2b8cbf-ea68-4961-ae17-64f6753e3974 with Priority: HIGHEST for action port [ 780.198062] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_rules [ 780.198062] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 780.198062] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2b8cbf-ea68-4961-ae17-64f6753e3974 with Priority: HIGHEST for action port [ 780.199084] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.199223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.199286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.199556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.199639] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.200597] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.200723] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.200989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.200989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.201123] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.201228] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.201310] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.201461] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.201551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.201647] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.202440] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e2b8cbf-ea68-4961-ae17-64f6753e3974 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.202529] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.202843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.202843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.202843] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2b8cbf-ea68-4961-ae17-64f6753e3974',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.705715] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.706061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.706577] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.707667] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e2b8cbf-ea68-4961-ae17-64f6753e3974 with status ACTIVE [ 780.707799] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.707926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.708018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.708252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.708348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.708543] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.717022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.717022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.717022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.717022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.717022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.717022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.717022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.717022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.717022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.717022] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e2b8cbf-ea68-4961-ae17-64f6753e3974 is going to be updated. [ 780.738178] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.738178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.738178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.738178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.738515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.738515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.215905] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.321422] env[70006]: INFO networking_nsxv3.common.synchronization [req-b726d792-fd0c-4941-a734-fa707e8a7f36 req-9182a377-b04f-4a64-a3cc-ec6aaa4293a1 tempest-TenantUsagesTestJSON-708809549 tempest-TenantUsagesTestJSON-708809549-project-member] Enqueued Resource ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 with Priority: HIGHEST for action security_group_members [ 781.322107] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 with Priority: HIGHEST for action security_group_members [ 781.322305] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0b97f55-8a3c-470a-80b7-2654d4b73517 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.322424] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.322554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.322738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.322890] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.322976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.323066] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.325179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.325179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.325179] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0b97f55-8a3c-470a-80b7-2654d4b73517',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.631678] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 in Status: SUCCESS [ 781.631678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.631678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.631678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.631678] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.631678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.631678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.631678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.631678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.631678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.631678] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.720204] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.720204] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.720204] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.720204] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.722832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.722832] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be created. [ 781.751733] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.754022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.754022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.754022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.754022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.765877] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: UNINITIALIZED for 2s [ 781.827038] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.827252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.827324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.827548] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.827639] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.827843] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.827945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.828027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.828179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.828253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.828337] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 already deleted. [ 781.828416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.992789] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.993012] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.993774] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.993819] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.994172] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.994301] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.994396] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.994687] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.994849] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.995356] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 781.995714] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 781.995714] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 781.995824] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 781.995984] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 781.996238] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 781.996446] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.022239] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.022239] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 782.022239] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.022239] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.022239] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-42a0109b-8ff8-4977-b5ce-f0caa32df87e taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.022239] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-42a0109b-8ff8-4977-b5ce-f0caa32df87e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.022239] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-42a0109b-8ff8-4977-b5ce-f0caa32df87e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.022239] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-42a0109b-8ff8-4977-b5ce-f0caa32df87e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.022239] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a0109b-8ff8-4977-b5ce-f0caa32df87e',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.135351] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.135351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.135351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.135351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.135351] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.135351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.135351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.135351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.135351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.135351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.135351] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.135351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.135351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.135759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.135759] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.135759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.135759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.135862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.135888] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.136076] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.136076] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.360411] env[70006]: INFO networking_nsxv3.common.synchronization [None req-62e09360-3f16-4061-bc4f-d2e11f3851d4 None None] Enqueued Resource ID: ee004eac-c122-4498-9ded-ff307d0b095f with Priority: HIGHEST for action port [ 782.360677] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee004eac-c122-4498-9ded-ff307d0b095f with Priority: HIGHEST for action port [ 782.361271] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee004eac-c122-4498-9ded-ff307d0b095f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.361401] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee004eac-c122-4498-9ded-ff307d0b095f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.361470] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee004eac-c122-4498-9ded-ff307d0b095f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.361733] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee004eac-c122-4498-9ded-ff307d0b095f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.361814] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee004eac-c122-4498-9ded-ff307d0b095f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.524331] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.524576] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.524714] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.525019] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.525195] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.525394] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 42a0109b-8ff8-4977-b5ce-f0caa32df87e not found, creating... [ 782.525724] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.526421] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.526609] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.526934] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.527079] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.527742] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.528031] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.528207] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.528508] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.528686] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.528862] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 42a0109b-8ff8-4977-b5ce-f0caa32df87e is going to be created. [ 782.556765] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.556765] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.556765] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.556765] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.556765] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.557290] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-42a0109b-8ff8-4977-b5ce-f0caa32df87e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.638689] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98: rpc.has_security_group_logging(os_id): False [ 782.658286] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.658474] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.658579] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.659907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.659907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.659907] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.659907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.659907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.660202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.664266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.664622] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.664767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.664882] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.665121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.665224] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.665427] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.665531] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.665597] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.665762] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.665843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.665927] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 is going to be updated. [ 782.740395] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.740695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.740695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.740794] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.740938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.759703] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 in Status: IN_PROGRESS for 2s [ 782.864383] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee004eac-c122-4498-9ded-ff307d0b095f [ 782.864659] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.864813] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.864896] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.865140] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.865255] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.865355] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee004eac-c122-4498-9ded-ff307d0b095f already deleted. [ 782.865457] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee004eac-c122-4498-9ded-ff307d0b095f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.279133] env[70006]: INFO networking_nsxv3.common.synchronization [req-b726d792-fd0c-4941-a734-fa707e8a7f36 req-9d71480a-2a8b-4649-9c31-b61ec64c1796 service nova] Enqueued Resource ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 with Priority: HIGHEST for action security_group_rules [ 783.279133] env[70006]: INFO networking_nsxv3.common.synchronization [req-b726d792-fd0c-4941-a734-fa707e8a7f36 req-9d71480a-2a8b-4649-9c31-b61ec64c1796 service nova] Enqueued Resource ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 with Priority: HIGHEST for action security_group_members [ 783.279133] env[70006]: INFO networking_nsxv3.common.synchronization [req-b726d792-fd0c-4941-a734-fa707e8a7f36 req-9d71480a-2a8b-4649-9c31-b61ec64c1796 service nova] Enqueued Resource ID: 42a0109b-8ff8-4977-b5ce-f0caa32df87e with Priority: HIGHEST for action port [ 783.279296] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 with Priority: HIGHEST for action security_group_rules [ 783.279414] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 with Priority: HIGHEST for action security_group_members [ 783.279566] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a0109b-8ff8-4977-b5ce-f0caa32df87e with Priority: HIGHEST for action port [ 783.282740] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0b97f55-8a3c-470a-80b7-2654d4b73517 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.282834] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.282834] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.283106] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.283700] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0b97f55-8a3c-470a-80b7-2654d4b73517',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.286685] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0b97f55-8a3c-470a-80b7-2654d4b73517 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.286685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.286685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.286685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.286685] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.286685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.286685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.286685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.286685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.286685] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0b97f55-8a3c-470a-80b7-2654d4b73517',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.288121] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-42a0109b-8ff8-4977-b5ce-f0caa32df87e taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.288121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42a0109b-8ff8-4977-b5ce-f0caa32df87e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.288121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42a0109b-8ff8-4977-b5ce-f0caa32df87e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.288121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42a0109b-8ff8-4977-b5ce-f0caa32df87e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.288121] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a0109b-8ff8-4977-b5ce-f0caa32df87e',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.780193] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 783.780437] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.780593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.780805] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.780993] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.782651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.782651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.782651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.782651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.782651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.782651] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.790206] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0b97f55-8a3c-470a-80b7-2654d4b73517',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.790369] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0b97f55-8a3c-470a-80b7-2654d4b73517 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.791177] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.796513] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42a0109b-8ff8-4977-b5ce-f0caa32df87e with status ACTIVE [ 783.799045] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.799045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.799045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.799045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.799045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.799045] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.799045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.799045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.799045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.799535] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.799535] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.799535] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.799535] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.799689] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.799773] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.800386] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42a0109b-8ff8-4977-b5ce-f0caa32df87e is going to be updated. [ 783.823035] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.823207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.823262] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.823491] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.823621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.823778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42a0109b-8ff8-4977-b5ce-f0caa32df87e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.286897] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.287148] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.287250] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.287520] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.287771] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.287919] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.287992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.288293] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.288293] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.288375] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.288826] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.288826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.288826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.289512] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.289677] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.289780] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.289844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.289995] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.290531] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.290638] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.290744] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.292096] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0b97f55-8a3c-470a-80b7-2654d4b73517',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.778709] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 in Status: SUCCESS [ 784.778709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.793557] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6: rpc.has_security_group_logging(os_id): False [ 784.802565] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.802728] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.802801] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.803027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.804642] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.804642] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 is going to be created. [ 784.813653] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.813653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.813653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.813653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.813653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.813653] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.813653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.813653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.813653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.813653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.813653] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.815627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.815627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.815627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.815627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.816382] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.816525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.816593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.816825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.816864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.816981] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be created. [ 784.835486] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.835629] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.836801] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.836801] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.836801] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.848263] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 in Status: UNINITIALIZED for 2s [ 784.889139] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.889336] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.889408] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.889707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.889855] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.905181] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 784.953139] env[70006]: INFO networking_nsxv3.common.synchronization [None req-33102798-4f93-4472-8e70-81be6b6e7696 None None] Enqueued Resource ID: 27eb52b9-9834-45b8-8972-6a2d8f673236 with Priority: HIGHEST for action port [ 784.954678] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27eb52b9-9834-45b8-8972-6a2d8f673236 with Priority: HIGHEST for action port [ 784.955430] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-27eb52b9-9834-45b8-8972-6a2d8f673236 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.955430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27eb52b9-9834-45b8-8972-6a2d8f673236" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.955578] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27eb52b9-9834-45b8-8972-6a2d8f673236" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.955788] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27eb52b9-9834-45b8-8972-6a2d8f673236" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.955925] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27eb52b9-9834-45b8-8972-6a2d8f673236',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.459936] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27eb52b9-9834-45b8-8972-6a2d8f673236 [ 785.459936] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.459936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.459936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.459936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.459936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.459936] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27eb52b9-9834-45b8-8972-6a2d8f673236 already deleted. [ 785.459936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27eb52b9-9834-45b8-8972-6a2d8f673236" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.862949] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 in Status: SUCCESS [ 786.862949] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.862949] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.862949] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.862949] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.862949] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.862949] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.863945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.864173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.864392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.864598] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0b97f55-8a3c-470a-80b7-2654d4b73517',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.953222] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 786.953562] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.371636] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0b97f55-8a3c-470a-80b7-2654d4b73517 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.371846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.371924] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.372205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.372414] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.372586] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.372658] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.372850] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.373275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.373275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.373543] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0b97f55-8a3c-470a-80b7-2654d4b73517 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.373637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.373637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.373810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.374014] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.374202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.374279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.374447] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.374553] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.374644] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.374763] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0b97f55-8a3c-470a-80b7-2654d4b73517',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.877896] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0b97f55-8a3c-470a-80b7-2654d4b73517: rpc.has_security_group_logging(os_id): False [ 787.900582] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.900810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.900971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.903142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.903142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.903142] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.903142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.903142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.903142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.903142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.903142] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.903142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.903794] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.903794] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.903794] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.904069] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.904775] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.904892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.905117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.905253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.905384] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 is going to be created. [ 787.985022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.985206] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.987382] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.987738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.987961] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.999632] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 in Status: IN_PROGRESS for 2s [ 788.200664] env[70006]: INFO networking_nsxv3.common.synchronization [req-503df2ef-56ec-4211-ad1d-e3b293faaf8e req-37bf08d7-4037-45ef-84d6-6d36c841b98c tempest-DeleteServersAdminTestJSON-1843386794 tempest-DeleteServersAdminTestJSON-1843386794-project-member] Enqueued Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_members [ 788.201226] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGHEST for action security_group_members [ 788.201561] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.201688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.201755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.202118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.202118] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.202230] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.202503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.202503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.202503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.202601] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.439543] env[70006]: INFO networking_nsxv3.common.synchronization [None req-1307e30d-bca6-426c-86a7-c9c14763c39b None None] Enqueued Resource ID: cd331144-beaa-4c17-b644-8628434d5888 with Priority: HIGHEST for action port [ 788.440229] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd331144-beaa-4c17-b644-8628434d5888 with Priority: HIGHEST for action port [ 788.440848] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd331144-beaa-4c17-b644-8628434d5888 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.441693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd331144-beaa-4c17-b644-8628434d5888" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.441800] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd331144-beaa-4c17-b644-8628434d5888" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.443193] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd331144-beaa-4c17-b644-8628434d5888" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.443193] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd331144-beaa-4c17-b644-8628434d5888',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.705890] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.706074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.706118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.706337] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.706444] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.706641] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.706740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.706844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.706959] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.707081] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.707165] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 is going to be updated. [ 788.737844] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.738472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.738573] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.738885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.739209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.749510] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 in Status: IN_PROGRESS for 2s [ 788.945313] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd331144-beaa-4c17-b644-8628434d5888 [ 788.945545] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.945545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.945634] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.946288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.946288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.946288] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd331144-beaa-4c17-b644-8628434d5888 already deleted. [ 788.946288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd331144-beaa-4c17-b644-8628434d5888" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.083928] env[70006]: INFO networking_nsxv3.common.synchronization [req-e00fa655-44ce-4c16-94f8-b4f0838b1cac req-a142193d-d84d-47be-a50a-1211cadaa7df tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGHEST for action security_group_members [ 789.084612] env[70006]: INFO networking_nsxv3.common.synchronization [req-e00fa655-44ce-4c16-94f8-b4f0838b1cac req-a142193d-d84d-47be-a50a-1211cadaa7df tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 789.086266] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGHEST for action security_group_members [ 789.086463] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 789.086806] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-041bde4c-c513-4b39-85d4-3d543865b6f0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.086944] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.087034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.087387] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.087591] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.087706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.087761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.087992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.088059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.088162] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.089195] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.089323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.089418] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.089646] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.089859] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.090029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.092170] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.092383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.092506] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.092633] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.238190] env[70006]: INFO networking_nsxv3.common.synchronization [req-e00fa655-44ce-4c16-94f8-b4f0838b1cac req-a142193d-d84d-47be-a50a-1211cadaa7df tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGHEST for action security_group_rules [ 789.238412] env[70006]: INFO networking_nsxv3.common.synchronization [req-e00fa655-44ce-4c16-94f8-b4f0838b1cac req-a142193d-d84d-47be-a50a-1211cadaa7df tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGHEST for action security_group_members [ 789.238493] env[70006]: INFO networking_nsxv3.common.synchronization [req-e00fa655-44ce-4c16-94f8-b4f0838b1cac req-a142193d-d84d-47be-a50a-1211cadaa7df tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_rules [ 789.238618] env[70006]: INFO networking_nsxv3.common.synchronization [req-e00fa655-44ce-4c16-94f8-b4f0838b1cac req-a142193d-d84d-47be-a50a-1211cadaa7df tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 789.238743] env[70006]: INFO networking_nsxv3.common.synchronization [req-e00fa655-44ce-4c16-94f8-b4f0838b1cac req-a142193d-d84d-47be-a50a-1211cadaa7df tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 9e2b8cbf-ea68-4961-ae17-64f6753e3974 with Priority: HIGHEST for action port [ 789.239637] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGHEST for action security_group_rules [ 789.239826] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_rules [ 789.239967] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2b8cbf-ea68-4961-ae17-64f6753e3974 with Priority: HIGHEST for action port [ 789.240087] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGHEST for action security_group_members [ 789.240208] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 789.240576] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-041bde4c-c513-4b39-85d4-3d543865b6f0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.240670] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.240756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.241079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.241169] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.242068] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.242219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.242310] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.242512] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.242607] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.243696] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e2b8cbf-ea68-4961-ae17-64f6753e3974 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.243852] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.243885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.244138] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.244202] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2b8cbf-ea68-4961-ae17-64f6753e3974',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.244966] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-041bde4c-c513-4b39-85d4-3d543865b6f0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.245105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.245456] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.245568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.595924] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.597020] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.749324] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-041bde4c-c513-4b39-85d4-3d543865b6f0 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.749324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.749324] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.749324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.749324] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e2b8cbf-ea68-4961-ae17-64f6753e3974 with status ACTIVE [ 789.749324] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.749324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.749324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.749324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.749324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.749324] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.749324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.749324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.749324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.749324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.749971] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.749971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.749971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.749971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.749971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.749971] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e2b8cbf-ea68-4961-ae17-64f6753e3974 is going to be updated. [ 789.772998] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.774167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.774321] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.774513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.775464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.775464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.004081] env[70006]: INFO networking_nsxv3.common.synchronization [req-9a823cf2-44cb-44c1-aa13-87a6beaee0d2 req-19f93e78-4582-4e15-8112-45500f15b19c tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 790.004081] env[70006]: INFO networking_nsxv3.common.synchronization [req-9a823cf2-44cb-44c1-aa13-87a6beaee0d2 req-19f93e78-4582-4e15-8112-45500f15b19c tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: ce0190ac-bf23-4a10-82de-268e3bc82647 with Priority: HIGHEST for action security_group_members [ 790.004081] env[70006]: INFO networking_nsxv3.common.synchronization [req-9a823cf2-44cb-44c1-aa13-87a6beaee0d2 req-19f93e78-4582-4e15-8112-45500f15b19c tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGHEST for action security_group_members [ 790.005011] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 790.005011] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce0190ac-bf23-4a10-82de-268e3bc82647 with Priority: HIGHEST for action security_group_members [ 790.005011] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGHEST for action security_group_members [ 790.006028] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.006028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.007148] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce0190ac-bf23-4a10-82de-268e3bc82647 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.007272] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.007324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.007574] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.008276] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.008276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.008276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.008276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.008276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.008276] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce0190ac-bf23-4a10-82de-268e3bc82647',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.009255] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-041bde4c-c513-4b39-85d4-3d543865b6f0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.009467] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.030822] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 in Status: SUCCESS [ 790.032592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.075019] env[70006]: INFO networking_nsxv3.common.synchronization [req-9a823cf2-44cb-44c1-aa13-87a6beaee0d2 req-19f93e78-4582-4e15-8112-45500f15b19c tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGHEST for action security_group_rules [ 790.075916] env[70006]: INFO networking_nsxv3.common.synchronization [req-9a823cf2-44cb-44c1-aa13-87a6beaee0d2 req-19f93e78-4582-4e15-8112-45500f15b19c tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGHEST for action security_group_members [ 790.076438] env[70006]: INFO networking_nsxv3.common.synchronization [req-9a823cf2-44cb-44c1-aa13-87a6beaee0d2 req-19f93e78-4582-4e15-8112-45500f15b19c tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_rules [ 790.077381] env[70006]: INFO networking_nsxv3.common.synchronization [req-9a823cf2-44cb-44c1-aa13-87a6beaee0d2 req-19f93e78-4582-4e15-8112-45500f15b19c tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 790.077635] env[70006]: INFO networking_nsxv3.common.synchronization [req-9a823cf2-44cb-44c1-aa13-87a6beaee0d2 req-19f93e78-4582-4e15-8112-45500f15b19c tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: ce0190ac-bf23-4a10-82de-268e3bc82647 with Priority: HIGHEST for action security_group_rules [ 790.077966] env[70006]: INFO networking_nsxv3.common.synchronization [req-9a823cf2-44cb-44c1-aa13-87a6beaee0d2 req-19f93e78-4582-4e15-8112-45500f15b19c tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: ce0190ac-bf23-4a10-82de-268e3bc82647 with Priority: HIGHEST for action security_group_members [ 790.078311] env[70006]: INFO networking_nsxv3.common.synchronization [req-9a823cf2-44cb-44c1-aa13-87a6beaee0d2 req-19f93e78-4582-4e15-8112-45500f15b19c tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 9e2b8cbf-ea68-4961-ae17-64f6753e3974 with Priority: HIGHEST for action port [ 790.079300] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGHEST for action security_group_rules [ 790.079551] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_rules [ 790.079748] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce0190ac-bf23-4a10-82de-268e3bc82647 with Priority: HIGHEST for action security_group_members [ 790.079929] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2b8cbf-ea68-4961-ae17-64f6753e3974 with Priority: HIGHEST for action port [ 790.081019] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce0190ac-bf23-4a10-82de-268e3bc82647 with Priority: HIGHEST for action security_group_rules [ 790.081019] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGHEST for action security_group_members [ 790.081019] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 790.081019] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-041bde4c-c513-4b39-85d4-3d543865b6f0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.081019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.081019] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.081354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.082258] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce0190ac-bf23-4a10-82de-268e3bc82647 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.082511] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.082828] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e2b8cbf-ea68-4961-ae17-64f6753e3974 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.083060] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.083215] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.083623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.086021] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2b8cbf-ea68-4961-ae17-64f6753e3974',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.086021] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce0190ac-bf23-4a10-82de-268e3bc82647 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.086021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.086021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.086021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.086021] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce0190ac-bf23-4a10-82de-268e3bc82647',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.086547] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-041bde4c-c513-4b39-85d4-3d543865b6f0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.086739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.087030] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.087247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.100567] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.103037] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.510472] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce0190ac-bf23-4a10-82de-268e3bc82647',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.588732] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e2b8cbf-ea68-4961-ae17-64f6753e3974 with status ACTIVE [ 790.589739] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.589739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.589739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.589739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.590316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.593061] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.593061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.593061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.593061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.593061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.593061] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.593061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.593061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.593061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.593061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.593061] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e2b8cbf-ea68-4961-ae17-64f6753e3974 is going to be updated. [ 790.593061] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce0190ac-bf23-4a10-82de-268e3bc82647 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.593061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.605283] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.605283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.605283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.605283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.605283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.605283] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 is going to be created. [ 790.605283] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.605283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.605283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.605283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.605283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.605283] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 790.620172] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.622810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.622810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.622810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.622810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.622810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e2b8cbf-ea68-4961-ae17-64f6753e3974" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.633077] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.637245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.637245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.637245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.637245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.648372] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: UNINITIALIZED for 2s [ 790.662045] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.662225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.662303] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.662798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.662798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.675768] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 790.765938] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 in Status: SUCCESS [ 790.766154] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 deletion is rescheduled due to dependency. [ 790.766268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.014438] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce0190ac-bf23-4a10-82de-268e3bc82647',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.093561] env[70006]: INFO networking_nsxv3.common.synchronization [None req-f9a42cfe-d35a-487e-b685-3569719c11f4 None None] Enqueued Resource ID: 48f5721b-a731-422a-87ac-db7e256c9c20 with Priority: HIGHEST for action port [ 791.093791] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48f5721b-a731-422a-87ac-db7e256c9c20 with Priority: HIGHEST for action port [ 791.094793] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-48f5721b-a731-422a-87ac-db7e256c9c20 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.094793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48f5721b-a731-422a-87ac-db7e256c9c20" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.094793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48f5721b-a731-422a-87ac-db7e256c9c20" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.095011] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48f5721b-a731-422a-87ac-db7e256c9c20" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.097230] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48f5721b-a731-422a-87ac-db7e256c9c20',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.518618] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.519329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.519401] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.519656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.519757] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.519867] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce0190ac-bf23-4a10-82de-268e3bc82647 is going to be created. [ 791.547169] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.547358] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.547358] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.547803] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.547803] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.560536] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce0190ac-bf23-4a10-82de-268e3bc82647 in Status: UNINITIALIZED for 2s [ 791.600676] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48f5721b-a731-422a-87ac-db7e256c9c20 [ 791.600977] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.601184] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.601278] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.601515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.602525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.602651] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48f5721b-a731-422a-87ac-db7e256c9c20 already deleted. [ 791.602756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48f5721b-a731-422a-87ac-db7e256c9c20" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.681266] env[70006]: INFO networking_nsxv3.common.synchronization [None req-e9429ba4-2478-43a6-9005-f12f4abf9e02 None None] Enqueued Resource ID: 084ec90f-9621-4879-8fe6-d144269c6722 with Priority: HIGHEST for action port [ 791.681266] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 084ec90f-9621-4879-8fe6-d144269c6722 with Priority: HIGHEST for action port [ 791.682351] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-084ec90f-9621-4879-8fe6-d144269c6722 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.682491] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-084ec90f-9621-4879-8fe6-d144269c6722" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.682561] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-084ec90f-9621-4879-8fe6-d144269c6722" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.682824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-084ec90f-9621-4879-8fe6-d144269c6722" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.682911] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('084ec90f-9621-4879-8fe6-d144269c6722',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.189219] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 084ec90f-9621-4879-8fe6-d144269c6722 [ 792.189487] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.189613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.189681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.189907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.189996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.190114] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:084ec90f-9621-4879-8fe6-d144269c6722 already deleted. [ 792.190873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-084ec90f-9621-4879-8fe6-d144269c6722" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.660978] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: SUCCESS [ 792.660978] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.661150] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.661375] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.661576] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.661695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.661766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.661927] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.662040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.662180] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.686899] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 792.686899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.686899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.687262] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.687939] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.689421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.689523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.689707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.689802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.689946] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.169904] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.193235] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.575653] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce0190ac-bf23-4a10-82de-268e3bc82647 in Status: SUCCESS [ 793.576487] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.576487] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.576932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.577170] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.577312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.577378] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.577606] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.577636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.578131] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce0190ac-bf23-4a10-82de-268e3bc82647',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.672749] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.700329] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.082436] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce0190ac-bf23-4a10-82de-268e3bc82647',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.175673] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.175873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.176185] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.176185] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.176399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.176399] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 is going to be updated. [ 794.203403] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.203789] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.203789] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.204039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.204039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.204039] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 794.225644] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.225864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.225972] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.226314] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.226542] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.236780] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: IN_PROGRESS for 2s [ 794.253890] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.254128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.254239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.254559] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.254773] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.265679] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 794.291077] env[70006]: INFO networking_nsxv3.common.synchronization [None req-65df4772-f769-4e91-b7e6-c2698c5e4967 None None] Enqueued Resource ID: da5929ad-5e09-4cd2-9b44-1c105941ed43 with Priority: HIGHEST for action port [ 794.292257] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da5929ad-5e09-4cd2-9b44-1c105941ed43 with Priority: HIGHEST for action port [ 794.293947] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-da5929ad-5e09-4cd2-9b44-1c105941ed43 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.294125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da5929ad-5e09-4cd2-9b44-1c105941ed43" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.294835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da5929ad-5e09-4cd2-9b44-1c105941ed43" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.294835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da5929ad-5e09-4cd2-9b44-1c105941ed43" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.294835] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da5929ad-5e09-4cd2-9b44-1c105941ed43',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.584962] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce0190ac-bf23-4a10-82de-268e3bc82647',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.798696] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da5929ad-5e09-4cd2-9b44-1c105941ed43 [ 794.798696] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.798696] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.798696] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.798696] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.798696] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.798696] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da5929ad-5e09-4cd2-9b44-1c105941ed43 already deleted. [ 794.798696] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da5929ad-5e09-4cd2-9b44-1c105941ed43" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.088381] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.088555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.088616] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.088821] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.088921] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.089033] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce0190ac-bf23-4a10-82de-268e3bc82647 is going to be updated. [ 795.130701] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.130853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.130939] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.131169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.131324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.151463] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce0190ac-bf23-4a10-82de-268e3bc82647 in Status: IN_PROGRESS for 2s [ 796.250360] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: SUCCESS [ 796.250360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.250360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.250360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.250360] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.253496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.253608] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.253806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.253905] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.253989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.254169] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.255312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.258341] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.258341] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.258341] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.258341] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.258341] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.258341] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.258341] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.277237] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 796.278081] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.278081] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.278181] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.278289] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.278432] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.278551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.278660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.278715] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.278806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.278903] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.279745] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.279976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.280085] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.280228] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.280296] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.280447] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.280527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.280617] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.761941] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.763087] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.782248] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.782372] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.782564] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.161852] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce0190ac-bf23-4a10-82de-268e3bc82647 in Status: SUCCESS [ 797.162087] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.162264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.162487] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.162678] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.162806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.162866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.163056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.163162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.163259] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.163354] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce0190ac-bf23-4a10-82de-268e3bc82647',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.266355] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 041bde4c-c513-4b39-85d4-3d543865b6f0: rpc.has_security_group_logging(os_id): False [ 797.266604] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.285810] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.289538] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.289679] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.289751] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.289964] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.290080] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.290300] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.290388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.290610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.290610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.290671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.290756] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 is going to be created. [ 797.357454] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.357454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.357454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.357454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.357454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.369828] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: IN_PROGRESS for 2s [ 797.669436] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce0190ac-bf23-4a10-82de-268e3bc82647',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.753309] env[70006]: INFO networking_nsxv3.common.synchronization [req-93ddc63c-5b66-4ce8-95c8-1c8bacd42411 req-76f293c4-3273-4ad7-bcd3-eb4bfeb43f94 tempest-TenantUsagesTestJSON-708809549 tempest-TenantUsagesTestJSON-708809549-project-member] Enqueued Resource ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 with Priority: HIGHEST for action security_group_members [ 797.753309] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 with Priority: HIGHEST for action security_group_members [ 797.753309] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0b97f55-8a3c-470a-80b7-2654d4b73517 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.753517] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.753517] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.753675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.753825] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.753921] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.753976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.754285] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.754384] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.754502] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0b97f55-8a3c-470a-80b7-2654d4b73517',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.768806] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.768806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.768806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.768946] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.769036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.769170] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 is going to be updated. [ 797.792479] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.792662] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.792709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.792932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.793039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.793136] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 797.797351] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.797561] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.797561] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.797799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.797902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.807972] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: IN_PROGRESS for 2s [ 797.823637] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.823637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.823637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.823637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.823637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.832904] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 798.171939] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce0190ac-bf23-4a10-82de-268e3bc82647: rpc.has_security_group_logging(os_id): False [ 798.202063] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.202218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.202348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.202517] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.202609] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.202838] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.202929] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.202990] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.203163] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.203242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.203330] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce0190ac-bf23-4a10-82de-268e3bc82647 is going to be created. [ 798.256115] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.256288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.256362] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.256581] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.256680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.256872] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.256968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.257043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.257204] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.257286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.257376] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 is going to be updated. [ 798.276941] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.277432] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.277432] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.277508] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.277665] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.289659] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce0190ac-bf23-4a10-82de-268e3bc82647 in Status: IN_PROGRESS for 2s [ 798.293077] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.293264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.293369] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.293703] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.293763] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.305624] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 in Status: IN_PROGRESS for 2s [ 798.555682] env[70006]: INFO networking_nsxv3.common.synchronization [req-90186932-37c8-47a6-a0b8-86f4b485265e req-788cb011-e07e-49d8-8f48-842215bfb946 tempest-ServersNegativeTestMultiTenantJSON-439672739 tempest-ServersNegativeTestMultiTenantJSON-439672739-project-member] Enqueued Resource ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca with Priority: HIGHEST for action security_group_members [ 798.556650] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca with Priority: HIGHEST for action security_group_members [ 798.557075] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.557373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.557489] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.557774] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.558431] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.558601] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.558708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.559016] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.559246] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.559486] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41eabc70-5aa4-49e9-9af0-7a72a3eccfca',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.960366] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.960490] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-770" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.960542] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-770" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.960872] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-770" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.961148] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.961299] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.961510] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.961633] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.961781] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.961969] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.962091] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.962198] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.962303] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.962407] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.962507] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.962635] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.983744] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.983938] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 798.984084] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.984425] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-770" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.984570] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-c7fc6ffa-a891-4805-adfe-0a1ed770b245 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.984741] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-c7fc6ffa-a891-4805-adfe-0a1ed770b245" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.984859] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-c7fc6ffa-a891-4805-adfe-0a1ed770b245" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.985218] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-c7fc6ffa-a891-4805-adfe-0a1ed770b245" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.985359] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7fc6ffa-a891-4805-adfe-0a1ed770b245',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.062564] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.062564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.062564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.062564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.062564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.062797] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.062848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.062889] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.063044] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.063716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.063716] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca already deleted. [ 799.063716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.383080] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: SUCCESS [ 799.383346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.383525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.383752] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.383840] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.468568] env[70006]: INFO networking_nsxv3.common.synchronization [req-30f5425b-5e55-4aa1-b5e1-7cf4981c03a8 req-c0074bbb-ade9-44e9-a1d2-f2ba16ba2430 tempest-ImagesOneServerTestJSON-378500094 tempest-ImagesOneServerTestJSON-378500094-project-member] Enqueued Resource ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a with Priority: HIGHEST for action security_group_members [ 799.468568] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a with Priority: HIGHEST for action security_group_members [ 799.468568] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.468568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.468568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.468568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.468840] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.468840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.468840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.468957] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.469259] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.469259] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07080bbd-9bb6-4803-a5af-fb39eb3eee3a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.487950] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.488423] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.488423] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.488577] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.488793] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.488873] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port c7fc6ffa-a891-4805-adfe-0a1ed770b245 not found, creating... [ 799.489182] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.489373] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.489493] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.489710] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.489846] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.490157] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.490314] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.490442] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.490648] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.490777] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.490914] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: c7fc6ffa-a891-4805-adfe-0a1ed770b245 is going to be created. [ 799.516078] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.516078] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.516078] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.516078] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.516078] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.516078] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-c7fc6ffa-a891-4805-adfe-0a1ed770b245" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.819804] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: SUCCESS [ 799.819804] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.819804] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.819804] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.819804] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.819804] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.819804] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.819804] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.819804] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.819804] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.842932] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 799.843542] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.844421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.846761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.846761] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.846761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.846761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.846761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.846761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.846761] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.886269] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-041bde4c-c513-4b39-85d4-3d543865b6f0 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.886834] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.972564] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.972899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.973077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.973774] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.973990] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.974317] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.974538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.975049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.975314] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.975489] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.975834] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a is going to be updated. [ 800.003616] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.006019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.006019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.006019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.006019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.014985] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a in Status: IN_PROGRESS for 2s [ 800.305093] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce0190ac-bf23-4a10-82de-268e3bc82647 in Status: SUCCESS [ 800.305840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.317293] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 in Status: SUCCESS [ 800.317627] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 deletion is rescheduled due to dependency. [ 800.317831] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.322099] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.348653] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.377166] env[70006]: INFO networking_nsxv3.common.synchronization [req-90186932-37c8-47a6-a0b8-86f4b485265e req-2e31a6b9-7103-4185-8d79-80b6065f4574 service nova] Enqueued Resource ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca with Priority: HIGHEST for action security_group_rules [ 800.378736] env[70006]: INFO networking_nsxv3.common.synchronization [req-90186932-37c8-47a6-a0b8-86f4b485265e req-2e31a6b9-7103-4185-8d79-80b6065f4574 service nova] Enqueued Resource ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca with Priority: HIGHEST for action security_group_members [ 800.378736] env[70006]: INFO networking_nsxv3.common.synchronization [req-90186932-37c8-47a6-a0b8-86f4b485265e req-2e31a6b9-7103-4185-8d79-80b6065f4574 service nova] Enqueued Resource ID: c7fc6ffa-a891-4805-adfe-0a1ed770b245 with Priority: HIGHEST for action port [ 800.378736] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca with Priority: HIGHEST for action security_group_rules [ 800.378736] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca with Priority: HIGHEST for action security_group_members [ 800.378736] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7fc6ffa-a891-4805-adfe-0a1ed770b245 with Priority: HIGHEST for action port [ 800.379481] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41eabc70-5aa4-49e9-9af0-7a72a3eccfca taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.379745] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.380378] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.380859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.384156] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41eabc70-5aa4-49e9-9af0-7a72a3eccfca',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.384156] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.384156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.384156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.384156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.384156] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.384156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.384156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.384156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.384156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.384156] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41eabc70-5aa4-49e9-9af0-7a72a3eccfca',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.384156] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7fc6ffa-a891-4805-adfe-0a1ed770b245 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.385241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7fc6ffa-a891-4805-adfe-0a1ed770b245" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.385585] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7fc6ffa-a891-4805-adfe-0a1ed770b245" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.386019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7fc6ffa-a891-4805-adfe-0a1ed770b245" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.386181] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7fc6ffa-a891-4805-adfe-0a1ed770b245',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.826016] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.851874] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.889331] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.889331] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.889462] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41eabc70-5aa4-49e9-9af0-7a72a3eccfca',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.890271] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7fc6ffa-a891-4805-adfe-0a1ed770b245 with status ACTIVE [ 800.890463] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.890577] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.891117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.891117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.891117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.891117] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.891312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.891312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.891368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.891521] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.891638] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.891726] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.891782] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.891916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.891982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.895706] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7fc6ffa-a891-4805-adfe-0a1ed770b245 is going to be updated. [ 800.921917] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.925264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.925264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.925441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.925515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.925676] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7fc6ffa-a891-4805-adfe-0a1ed770b245" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.033509] env[70006]: INFO networking_nsxv3.common.synchronization [None req-2f3d63fc-3cb8-4a92-8656-8bc2746a878d None None] Enqueued Resource ID: aefcf14a-6ce0-4ef4-9bbc-7ed1a6a4c06f with Priority: HIGHEST for action port [ 801.034876] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aefcf14a-6ce0-4ef4-9bbc-7ed1a6a4c06f with Priority: HIGHEST for action port [ 801.034876] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-aefcf14a-6ce0-4ef4-9bbc-7ed1a6a4c06f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.034876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aefcf14a-6ce0-4ef4-9bbc-7ed1a6a4c06f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.034876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aefcf14a-6ce0-4ef4-9bbc-7ed1a6a4c06f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.035064] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aefcf14a-6ce0-4ef4-9bbc-7ed1a6a4c06f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.035064] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aefcf14a-6ce0-4ef4-9bbc-7ed1a6a4c06f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.295748] env[70006]: INFO networking_nsxv3.common.synchronization [req-b1e2c263-22cd-4ca1-9956-1a952cac3598 req-61bc0606-8ce9-4f00-9626-d1bf2474d476 tempest-ImagesTestJSON-196229908 tempest-ImagesTestJSON-196229908-project-member] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 801.296522] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 801.297578] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.297578] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.297578] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.297578] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.297737] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.297737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.297810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.299046] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.299046] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.299046] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.328102] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.328283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.328283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.328448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.328584] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.328656] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 is going to be updated. [ 801.355393] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.355539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.355596] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.355942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.355942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.356063] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 801.376885] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.376885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.377197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.377232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.377970] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.386192] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: IN_PROGRESS for 2s [ 801.394268] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.394403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.394403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.395047] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.395047] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.399474] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41eabc70-5aa4-49e9-9af0-7a72a3eccfca',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.405555] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 801.537623] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aefcf14a-6ce0-4ef4-9bbc-7ed1a6a4c06f [ 801.537841] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.537976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.538062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.538295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.538388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.538485] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aefcf14a-6ce0-4ef4-9bbc-7ed1a6a4c06f already deleted. [ 801.538564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aefcf14a-6ce0-4ef4-9bbc-7ed1a6a4c06f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.805526] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.805669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.805738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.805956] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.806057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.806258] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.806351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.806426] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.806643] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.806722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.806810] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be updated. [ 801.827290] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.827490] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.827615] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.827879] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.828234] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.828404] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.828520] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.828743] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.828890] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.829611] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.829803] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.829923] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.830090] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.830229] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.830319] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.830458] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.834812] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.835036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.835036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.835204] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.835346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.853739] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: IN_PROGRESS for 2s [ 801.858031] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.858031] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 801.858031] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.858216] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.858634] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.858769] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.858840] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.859239] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.859407] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.902149] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.902149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.902149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.902149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.902149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.902149] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca is going to be created. [ 801.945689] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.945829] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.945890] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.946155] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.946316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.958030] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca in Status: UNINITIALIZED for 2s [ 802.025157] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a in Status: SUCCESS [ 802.026263] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a deletion is rescheduled due to dependency. [ 802.026442] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.368048] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.368048] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.368048] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.368048] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.368048] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.368048] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3 not found, creating... [ 802.368048] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.368048] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.368048] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.368048] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.368048] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.368629] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.368629] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.368629] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.368875] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.368943] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.369604] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3 is going to be created. [ 802.392266] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.394110] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.394110] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.394110] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.394110] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.394110] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.138671] env[70006]: INFO networking_nsxv3.common.synchronization [req-b1e2c263-22cd-4ca1-9956-1a952cac3598 req-bc62df62-959c-4a81-8dd7-7a61dbc6a481 service nova] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_rules [ 803.138860] env[70006]: INFO networking_nsxv3.common.synchronization [req-b1e2c263-22cd-4ca1-9956-1a952cac3598 req-bc62df62-959c-4a81-8dd7-7a61dbc6a481 service nova] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 803.138998] env[70006]: INFO networking_nsxv3.common.synchronization [req-b1e2c263-22cd-4ca1-9956-1a952cac3598 req-bc62df62-959c-4a81-8dd7-7a61dbc6a481 service nova] Enqueued Resource ID: 7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3 with Priority: HIGHEST for action port [ 803.139660] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_rules [ 803.139747] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 803.140373] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3 with Priority: HIGHEST for action port [ 803.141334] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.141488] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.141555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.141768] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.141848] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.143767] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.143865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.144081] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.144332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.144332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.144461] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.144489] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.399982] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: SUCCESS [ 803.400630] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.400912] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.401227] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.401880] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.402159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.402313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.403075] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.403266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.403460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.403637] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.416917] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 803.416917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.416917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.416917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.417320] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.417609] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.417769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.418017] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.418740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.418740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.418740] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.418740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.418740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.418740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.419371] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.419650] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.420524] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.420524] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.420524] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.420524] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.420524] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.446488] env[70006]: INFO networking_nsxv3.common.synchronization [None req-bea7efd0-922b-456a-a948-4dc6895cadc4 None None] Enqueued Resource ID: a855fd3f-3e0f-47f1-bf5c-2de30de9b36f with Priority: HIGHEST for action port [ 803.447653] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a855fd3f-3e0f-47f1-bf5c-2de30de9b36f with Priority: HIGHEST for action port [ 803.448511] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-a855fd3f-3e0f-47f1-bf5c-2de30de9b36f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.448840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a855fd3f-3e0f-47f1-bf5c-2de30de9b36f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.449028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a855fd3f-3e0f-47f1-bf5c-2de30de9b36f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.449492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a855fd3f-3e0f-47f1-bf5c-2de30de9b36f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.449627] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a855fd3f-3e0f-47f1-bf5c-2de30de9b36f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.648980] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.649273] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.649667] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3 with status ACTIVE [ 803.649966] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.650101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.650184] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.650415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.650500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.650664] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.650756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.650816] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.650959] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.651051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.651225] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.651310] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.651367] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.651504] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.651592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.651673] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3 is going to be updated. [ 803.675961] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.676132] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.676202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.676416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.676550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.676706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7feff77e-7bce-4e3d-8d5a-36ed30ea0fc3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.871117] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 803.871341] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 deletion is rescheduled due to dependency. [ 803.871480] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.871677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.871931] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.872150] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.872274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.872365] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.872534] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.872648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.872738] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.906372] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.928034] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6: rpc.has_security_group_logging(os_id): False [ 803.951036] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.951036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.951036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.951036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.951036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.951036] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.951036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.951036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.951036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.951036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.951742] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.951742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.951742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.951742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.951742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.951742] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.952134] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.952134] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.952134] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.952284] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.952331] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 803.954694] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a855fd3f-3e0f-47f1-bf5c-2de30de9b36f [ 803.954694] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.954694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.954694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.954694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.954694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.954694] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a855fd3f-3e0f-47f1-bf5c-2de30de9b36f already deleted. [ 803.954694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a855fd3f-3e0f-47f1-bf5c-2de30de9b36f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.973083] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca in Status: SUCCESS [ 803.973327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.973575] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.973735] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.973940] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.974069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.974132] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.974345] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.974390] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.974438] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.974533] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41eabc70-5aa4-49e9-9af0-7a72a3eccfca',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.054273] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.054448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.054526] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.054706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.054859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.074658] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 804.376783] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.408509] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 041bde4c-c513-4b39-85d4-3d543865b6f0: rpc.has_security_group_logging(os_id): False [ 804.429077] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.429367] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.429367] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.429539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.429639] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.429870] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.429957] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.430022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.430173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.430252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.430349] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 is going to be updated. [ 804.479929] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.480132] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.480196] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.480516] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.480705] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.480813] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.480871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.481067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.481161] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.481250] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.481664] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.481868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.481868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.481971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.482120] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.482214] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.482272] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.482408] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.482488] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.482570] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.482743] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41eabc70-5aa4-49e9-9af0-7a72a3eccfca',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.495078] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.495245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.495306] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.495489] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.495916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.509430] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: IN_PROGRESS for 2s [ 804.882402] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.986019] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41eabc70-5aa4-49e9-9af0-7a72a3eccfca: rpc.has_security_group_logging(os_id): False [ 805.011195] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.011195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.011195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.011195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.011195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.011195] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.011195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.011195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.011195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.011195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.011195] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.011195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.013989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.013989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.013989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.013989] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.013989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.013989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.013989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.013989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.013989] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca is going to be created. [ 805.122324] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.122324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.122324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.122324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.122324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.147757] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca in Status: IN_PROGRESS for 2s [ 805.380536] env[70006]: INFO networking_nsxv3.common.synchronization [None req-5baeada5-35ab-400f-b181-8b903f474a36 None None] Enqueued Resource ID: 0e72167f-1298-4c0c-a942-59266f892c30 with Priority: HIGHEST for action port [ 805.380900] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e72167f-1298-4c0c-a942-59266f892c30 with Priority: HIGHEST for action port [ 805.381505] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e72167f-1298-4c0c-a942-59266f892c30 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.381669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e72167f-1298-4c0c-a942-59266f892c30" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.383871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e72167f-1298-4c0c-a942-59266f892c30" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.383871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e72167f-1298-4c0c-a942-59266f892c30" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.383871] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e72167f-1298-4c0c-a942-59266f892c30',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.392024] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.392024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.392024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.392024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.392024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.392024] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be updated. [ 805.426707] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.426707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.426707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.427135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.427135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.436928] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: IN_PROGRESS for 2s [ 805.888670] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e72167f-1298-4c0c-a942-59266f892c30 [ 805.888937] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.889103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.889177] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.889452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.889544] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.889647] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e72167f-1298-4c0c-a942-59266f892c30 already deleted. [ 805.889733] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e72167f-1298-4c0c-a942-59266f892c30" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.091561] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 806.091561] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.091561] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.091853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.091884] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.523407] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: SUCCESS [ 806.523686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.597327] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.597555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.597555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.597793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.598176] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.598176] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.598176] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.599143] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.599143] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.599143] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.599143] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.706610] env[70006]: INFO networking_nsxv3.common.synchronization [None req-eb71faed-721e-4374-beb0-9c8e15994e21 tempest-ServersV294TestFqdnHostnames-1142748138 tempest-ServersV294TestFqdnHostnames-1142748138-project-member] Enqueued Resource ID: e45746ed-781c-4f14-807a-e9e8876db03b with Priority: HIGHEST for action security_group_rules [ 806.706610] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45746ed-781c-4f14-807a-e9e8876db03b with Priority: HIGHEST for action security_group_rules [ 806.707697] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e45746ed-781c-4f14-807a-e9e8876db03b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.707697] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.707697] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.710669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.710669] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e45746ed-781c-4f14-807a-e9e8876db03b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.836757] env[70006]: INFO networking_nsxv3.common.synchronization [None req-408fa26c-d438-485e-b3ca-c80c5322a656 tempest-ServersV294TestFqdnHostnames-1142748138 tempest-ServersV294TestFqdnHostnames-1142748138-project-member] Enqueued Resource ID: e45746ed-781c-4f14-807a-e9e8876db03b with Priority: HIGHEST for action security_group_rules [ 806.837783] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45746ed-781c-4f14-807a-e9e8876db03b with Priority: HIGHEST for action security_group_rules [ 806.838919] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e45746ed-781c-4f14-807a-e9e8876db03b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.838919] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.104017] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.104226] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.104306] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.104554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.104778] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.104879] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.105036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.105168] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.105265] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.105360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.105566] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.105686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.105801] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.105913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.106077] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.106188] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.106268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.106414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.106496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.106579] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.106668] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.163607] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca in Status: SUCCESS [ 807.163739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.186254] env[70006]: INFO networking_nsxv3.common.synchronization [req-928ca46b-9e6b-4510-afa9-269afeee6990 req-5dcb3516-1cc8-4b68-be67-0d1c2aa05f95 tempest-ServerActionsV293TestJSON-630636606 tempest-ServerActionsV293TestJSON-630636606-project-member] Enqueued Resource ID: b62110f9-4181-4c43-9e99-43fd5dff214d with Priority: HIGHEST for action security_group_members [ 807.186859] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62110f9-4181-4c43-9e99-43fd5dff214d with Priority: HIGHEST for action security_group_members [ 807.187747] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62110f9-4181-4c43-9e99-43fd5dff214d taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.187885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.188065] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.188627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.189469] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.189607] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.189678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.189876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.189971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.190084] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62110f9-4181-4c43-9e99-43fd5dff214d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.244788] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.245062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.245062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.245300] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.245394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.245449] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e45746ed-781c-4f14-807a-e9e8876db03b already deleted. [ 807.245535] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.245698] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.245992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.245992] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e45746ed-781c-4f14-807a-e9e8876db03b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.447998] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 807.448232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.448397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.448619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.450016] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.450016] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.450016] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.450016] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.450016] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.450016] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.450016] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.613439] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6: rpc.has_security_group_logging(os_id): False [ 807.637216] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.637506] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.637644] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.638280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.638280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.638551] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.639129] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.639129] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.639129] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.639314] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.639610] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.639895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.639895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.641384] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.641384] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.641384] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.641661] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.641661] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.642639] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.643071] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.643071] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 807.693123] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.693469] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.693595] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.693909] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.694359] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.694359] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.695538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.695538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.695538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.695538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.695538] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62110f9-4181-4c43-9e99-43fd5dff214d already deleted. [ 807.695538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.728567] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.728706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.728751] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.728958] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.729127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.745955] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 807.774888] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.775022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.775121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.775332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.775614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.775614] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e45746ed-781c-4f14-807a-e9e8876db03b already deleted. [ 807.775614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.853556] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-145 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.853758] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-145" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.854098] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-145" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.854593] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-145" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.854934] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.855121] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.855244] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.855484] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.855636] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.855926] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.856193] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.856253] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.856370] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.856529] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.856650] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.856789] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.878113] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.878320] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 807.878460] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.878674] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-145" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.878961] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.879153] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.879331] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.879693] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.879989] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.952278] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.952540] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.952673] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.953060] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.953537] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.953537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.953537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.953537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.953694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.953694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.953795] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.953874] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.954059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.954123] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.954264] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.954354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.954409] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.954546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.954622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.954704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.954827] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.044744] env[70006]: INFO networking_nsxv3.common.synchronization [None req-46648479-9b9b-4bb2-ab4f-09160f582ce2 None None] Enqueued Resource ID: 13cbce9d-1e88-4aac-8fd9-06b8fd002f3e with Priority: HIGHEST for action port [ 808.045065] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13cbce9d-1e88-4aac-8fd9-06b8fd002f3e with Priority: HIGHEST for action port [ 808.045673] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-13cbce9d-1e88-4aac-8fd9-06b8fd002f3e taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.046571] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13cbce9d-1e88-4aac-8fd9-06b8fd002f3e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.046571] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13cbce9d-1e88-4aac-8fd9-06b8fd002f3e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.046571] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13cbce9d-1e88-4aac-8fd9-06b8fd002f3e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.046571] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13cbce9d-1e88-4aac-8fd9-06b8fd002f3e',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.385253] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.385471] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.387406] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.387406] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.387406] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.387406] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8 not found, creating... [ 808.387406] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.387765] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.387765] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.388324] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.388468] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.388818] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.389054] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.389281] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.389574] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.389751] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.389926] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8 is going to be created. [ 808.414119] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.414311] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.414474] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.414868] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.414960] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.415190] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.456877] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46e7bb0e-3b0b-455c-8638-3cb59c191bf9: rpc.has_security_group_logging(os_id): False [ 808.487041] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.487285] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.487370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.487591] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.487699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.487913] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.488035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.488103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.488267] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.488356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.488562] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.488658] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.488721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.488862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.488937] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.489344] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.489478] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.489568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.489733] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.489843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.489970] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be updated. [ 808.549388] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13cbce9d-1e88-4aac-8fd9-06b8fd002f3e [ 808.549388] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.549388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.549388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.549388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.549388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.549709] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13cbce9d-1e88-4aac-8fd9-06b8fd002f3e already deleted. [ 808.549709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13cbce9d-1e88-4aac-8fd9-06b8fd002f3e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.589367] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.589537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.589609] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.589822] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.589970] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.603680] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: IN_PROGRESS for 2s [ 809.400461] env[70006]: INFO networking_nsxv3.common.synchronization [req-928ca46b-9e6b-4510-afa9-269afeee6990 req-908e6508-fe40-4dfd-8757-89e7a99d2fbc service nova] Enqueued Resource ID: b62110f9-4181-4c43-9e99-43fd5dff214d with Priority: HIGHEST for action security_group_rules [ 809.400737] env[70006]: INFO networking_nsxv3.common.synchronization [req-928ca46b-9e6b-4510-afa9-269afeee6990 req-908e6508-fe40-4dfd-8757-89e7a99d2fbc service nova] Enqueued Resource ID: b62110f9-4181-4c43-9e99-43fd5dff214d with Priority: HIGHEST for action security_group_members [ 809.400783] env[70006]: INFO networking_nsxv3.common.synchronization [req-928ca46b-9e6b-4510-afa9-269afeee6990 req-908e6508-fe40-4dfd-8757-89e7a99d2fbc service nova] Enqueued Resource ID: 2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8 with Priority: HIGHEST for action port [ 809.400995] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62110f9-4181-4c43-9e99-43fd5dff214d with Priority: HIGHEST for action security_group_rules [ 809.401534] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62110f9-4181-4c43-9e99-43fd5dff214d with Priority: HIGHEST for action security_group_members [ 809.401534] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8 with Priority: HIGHEST for action port [ 809.401770] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b62110f9-4181-4c43-9e99-43fd5dff214d taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.401885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.401951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.405794] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.405898] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b62110f9-4181-4c43-9e99-43fd5dff214d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.406881] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62110f9-4181-4c43-9e99-43fd5dff214d taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.410210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.410289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.412220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.412220] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.412220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.412220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.412220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.412220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.412220] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62110f9-4181-4c43-9e99-43fd5dff214d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.412659] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.412659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.412659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.412837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.412880] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.761286] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 809.761286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.915396] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62110f9-4181-4c43-9e99-43fd5dff214d taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.915555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.915815] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b62110f9-4181-4c43-9e99-43fd5dff214d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.922050] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8 with status ACTIVE [ 809.922050] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.922050] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.922269] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.922869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.922869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.922869] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.922869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.922869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.923094] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.923130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.923444] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.923990] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.924153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.924383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.924794] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.924959] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8 is going to be updated. [ 809.948553] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.948770] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.948924] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.949136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.949359] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.949556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cd50eea-d7e9-4cb1-9ca6-65573c52b7e8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.418164] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b62110f9-4181-4c43-9e99-43fd5dff214d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.623290] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 810.623620] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.921789] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.921947] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.922032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.922260] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.922356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.922457] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62110f9-4181-4c43-9e99-43fd5dff214d is going to be created. [ 810.958061] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.958287] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.958365] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.958595] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.958781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.970859] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62110f9-4181-4c43-9e99-43fd5dff214d in Status: UNINITIALIZED for 2s [ 811.508810] env[70006]: INFO networking_nsxv3.common.synchronization [None req-99b1e84c-915d-482a-ad98-3e0ab36438b1 None None] Enqueued Resource ID: cb573d39-5147-4327-af95-20319790d3d7 with Priority: HIGHEST for action port [ 811.509066] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb573d39-5147-4327-af95-20319790d3d7 with Priority: HIGHEST for action port [ 811.509718] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb573d39-5147-4327-af95-20319790d3d7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.509896] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb573d39-5147-4327-af95-20319790d3d7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.509947] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb573d39-5147-4327-af95-20319790d3d7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.510203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb573d39-5147-4327-af95-20319790d3d7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.510296] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb573d39-5147-4327-af95-20319790d3d7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.818327] env[70006]: INFO networking_nsxv3.common.synchronization [req-11e2379c-da57-46eb-8faa-c628c9000c16 req-94d356ce-bbb7-420b-a0b7-d50751847335 tempest-ServersNegativeTestMultiTenantJSON-439672739 tempest-ServersNegativeTestMultiTenantJSON-439672739-project-member] Enqueued Resource ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca with Priority: HIGHEST for action security_group_members [ 811.818495] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca with Priority: HIGHEST for action security_group_members [ 811.818701] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.818850] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.818880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.823270] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.823270] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.823379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.823413] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.824167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.824167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.824167] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41eabc70-5aa4-49e9-9af0-7a72a3eccfca',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.013141] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb573d39-5147-4327-af95-20319790d3d7 [ 812.013556] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.013556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.013675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.013852] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.013952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.014084] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb573d39-5147-4327-af95-20319790d3d7 already deleted. [ 812.014175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb573d39-5147-4327-af95-20319790d3d7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.326169] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.326309] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.326379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.326595] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.326687] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.327060] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.327060] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.327060] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.327278] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.327352] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.327439] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca is going to be updated. [ 812.358621] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.358798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.358798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.359905] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.359905] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.368371] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca in Status: IN_PROGRESS for 2s [ 812.982166] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62110f9-4181-4c43-9e99-43fd5dff214d in Status: SUCCESS [ 812.982166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.982166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.982553] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.982553] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.982645] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.982678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.982808] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.982891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.982991] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.983205] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b62110f9-4181-4c43-9e99-43fd5dff214d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.486155] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b62110f9-4181-4c43-9e99-43fd5dff214d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.987863] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b62110f9-4181-4c43-9e99-43fd5dff214d: rpc.has_security_group_logging(os_id): False [ 814.008968] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.009761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.009761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.009761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.009761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.010106] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.010226] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.010295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.010463] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.010572] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.010669] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b62110f9-4181-4c43-9e99-43fd5dff214d is going to be created. [ 814.083349] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.083559] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.083559] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.083862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.084019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.105210] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b62110f9-4181-4c43-9e99-43fd5dff214d in Status: IN_PROGRESS for 2s [ 814.378590] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca in Status: SUCCESS [ 814.378771] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca deletion is rescheduled due to dependency. [ 814.378914] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.809402] env[70006]: INFO networking_nsxv3.common.synchronization [None req-21cbf4d8-00f1-4a1c-b80e-80a2db403ad3 None None] Enqueued Resource ID: 80469351-e23d-4170-a49c-cfbd094a8d21 with Priority: HIGHEST for action port [ 814.809668] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80469351-e23d-4170-a49c-cfbd094a8d21 with Priority: HIGHEST for action port [ 814.810255] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-80469351-e23d-4170-a49c-cfbd094a8d21 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.810939] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80469351-e23d-4170-a49c-cfbd094a8d21" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.810939] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80469351-e23d-4170-a49c-cfbd094a8d21" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.810939] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80469351-e23d-4170-a49c-cfbd094a8d21" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.810939] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80469351-e23d-4170-a49c-cfbd094a8d21',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.315822] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 80469351-e23d-4170-a49c-cfbd094a8d21 [ 815.316554] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.316739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.316809] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.317403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.317403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.317403] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:80469351-e23d-4170-a49c-cfbd094a8d21 already deleted. [ 815.317515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80469351-e23d-4170-a49c-cfbd094a8d21" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.118606] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b62110f9-4181-4c43-9e99-43fd5dff214d in Status: SUCCESS [ 816.118669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.689547] env[70006]: INFO networking_nsxv3.common.synchronization [req-e2ee1783-f5c8-480b-8d04-fe71677e6d6c req-97a4f0f0-0b29-41d1-b4b3-4e442dcc2689 tempest-ServersAdminNegativeTestJSON-1617245453 tempest-ServersAdminNegativeTestJSON-1617245453-project-member] Enqueued Resource ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 with Priority: HIGHEST for action security_group_members [ 817.689547] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 with Priority: HIGHEST for action security_group_members [ 817.689547] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4e3fb3-c949-45ee-b225-af03d5526168 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.689547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.689547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.689547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.690066] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.690232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.690324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.690519] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.690658] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.690775] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a4e3fb3-c949-45ee-b225-af03d5526168',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.194842] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.195733] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.196269] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.197207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.197207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.197207] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.197207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.197207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.197207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.197592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.197781] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 is going to be updated. [ 818.255450] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.255450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.255450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.255450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.255749] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.277443] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 in Status: IN_PROGRESS for 2s [ 820.287899] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 in Status: SUCCESS [ 820.288173] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 deletion is rescheduled due to dependency. [ 820.288654] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.809127] env[70006]: INFO networking_nsxv3.common.synchronization [req-301c45a6-55d4-4f2e-bc21-1b06ffad2aa9 req-f9174a64-9d64-450b-818c-61def952ae21 tempest-ListImageFiltersTestJSON-570141788 tempest-ListImageFiltersTestJSON-570141788-project-member] Enqueued Resource ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf with Priority: HIGHEST for action security_group_members [ 820.809424] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf with Priority: HIGHEST for action security_group_members [ 820.809945] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.809945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.809945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.810434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.810600] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.810707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.810774] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.811748] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.811748] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.811904] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.314162] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.314542] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.314542] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.314719] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.314769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.314940] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.315057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.315121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.315285] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.315641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.315641] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf already deleted. [ 821.315641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.350137] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-208 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.353750] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.353750] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.353750] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.353750] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.353750] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.353750] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.353750] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.353750] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.353750] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.356830] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.356973] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.357101] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.357306] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.357452] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.357603] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.380615] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.380615] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 821.381369] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.381369] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-208" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.382800] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-629bce59-9f07-4ab6-b37e-5b1fd45aa634 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.383057] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-629bce59-9f07-4ab6-b37e-5b1fd45aa634" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.383156] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-629bce59-9f07-4ab6-b37e-5b1fd45aa634" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.383513] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-629bce59-9f07-4ab6-b37e-5b1fd45aa634" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.383767] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('629bce59-9f07-4ab6-b37e-5b1fd45aa634',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.888396] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.888690] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.888819] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.889155] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.889391] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.889592] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 629bce59-9f07-4ab6-b37e-5b1fd45aa634 not found, creating... [ 821.889882] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.890081] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.890264] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.890538] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.890734] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.891087] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.891270] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.891418] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.891683] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.891832] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.892010] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 629bce59-9f07-4ab6-b37e-5b1fd45aa634 is going to be created. [ 821.915171] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.915386] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.915506] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.915788] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.916023] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.916243] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-629bce59-9f07-4ab6-b37e-5b1fd45aa634" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.770678] env[70006]: INFO networking_nsxv3.common.synchronization [req-301c45a6-55d4-4f2e-bc21-1b06ffad2aa9 req-75dbaecf-8e00-414e-9a0f-7758194f536d service nova] Enqueued Resource ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf with Priority: HIGHEST for action security_group_rules [ 822.770993] env[70006]: INFO networking_nsxv3.common.synchronization [req-301c45a6-55d4-4f2e-bc21-1b06ffad2aa9 req-75dbaecf-8e00-414e-9a0f-7758194f536d service nova] Enqueued Resource ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf with Priority: HIGHEST for action security_group_members [ 822.770993] env[70006]: INFO networking_nsxv3.common.synchronization [req-301c45a6-55d4-4f2e-bc21-1b06ffad2aa9 req-75dbaecf-8e00-414e-9a0f-7758194f536d service nova] Enqueued Resource ID: 629bce59-9f07-4ab6-b37e-5b1fd45aa634 with Priority: HIGHEST for action port [ 822.771530] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf with Priority: HIGHEST for action security_group_rules [ 822.771671] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf with Priority: HIGHEST for action security_group_members [ 822.771765] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 629bce59-9f07-4ab6-b37e-5b1fd45aa634 with Priority: HIGHEST for action port [ 822.772125] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.772219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.772219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.772478] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.772584] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.773444] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.773533] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.773601] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.773767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.773909] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.773998] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.774071] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.774207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.774290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.774378] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.775169] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-629bce59-9f07-4ab6-b37e-5b1fd45aa634 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.775279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-629bce59-9f07-4ab6-b37e-5b1fd45aa634" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.775346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-629bce59-9f07-4ab6-b37e-5b1fd45aa634" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.775494] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-629bce59-9f07-4ab6-b37e-5b1fd45aa634" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.775567] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('629bce59-9f07-4ab6-b37e-5b1fd45aa634',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.278025] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.279198] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.279333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.279521] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 629bce59-9f07-4ab6-b37e-5b1fd45aa634 with status ACTIVE [ 823.279692] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.279874] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.279874] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.280152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.280261] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.280543] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.280599] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.280769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.280866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.280935] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.283226] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.283440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.283500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.283664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.283743] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.283837] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 629bce59-9f07-4ab6-b37e-5b1fd45aa634 is going to be updated. [ 823.309614] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.309755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.309839] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.310060] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.310208] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.310787] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-629bce59-9f07-4ab6-b37e-5b1fd45aa634" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.332223] env[70006]: INFO networking_nsxv3.common.synchronization [req-564dc407-d78e-45ea-8729-ffc3de35dd31 req-b642e705-e7c6-4902-899f-b5616411c16c tempest-ListServersNegativeTestJSON-1085704939 tempest-ListServersNegativeTestJSON-1085704939-project-member] Enqueued Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_members [ 823.332722] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_members [ 823.333070] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-745088da-b183-4222-8402-76e909adaab2 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.333205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.333274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.333544] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.333702] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.333803] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.333865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.334077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.334107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.334204] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.784384] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.785060] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-433" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.786249] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-433" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.786249] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-433" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.786249] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.786647] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.786899] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.787287] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.787549] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.790017] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 823.790017] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.790017] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.790017] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.790017] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 823.790017] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.790017] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.790017] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.810249] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.810249] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 823.810628] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.812985] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-433" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.812985] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.812985] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.812985] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.812985] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.812985] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.843042] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.843042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.843042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.843235] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.843383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.843518] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.843614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.843675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.843824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.844031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.844031] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745088da-b183-4222-8402-76e909adaab2 already deleted. [ 823.844187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.293450] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.293715] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.293827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.294074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.294173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.294303] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf is going to be created. [ 824.314483] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.314789] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.314849] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.315124] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.315331] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.315430] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230 not found, creating... [ 824.315734] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.315900] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.316032] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.316262] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.316405] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.316677] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.316828] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.316944] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.317163] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.317320] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.317474] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230 is going to be created. [ 824.319681] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.319823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.319881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.320011] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.320561] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.332841] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf in Status: UNINITIALIZED for 2s [ 824.339845] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.340091] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.340179] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.340490] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.340752] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.340976] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.173834] env[70006]: INFO networking_nsxv3.common.synchronization [req-564dc407-d78e-45ea-8729-ffc3de35dd31 req-ac714f84-b3d6-46d4-a3ec-617f7ad082ef service nova] Enqueued Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_rules [ 825.174149] env[70006]: INFO networking_nsxv3.common.synchronization [req-564dc407-d78e-45ea-8729-ffc3de35dd31 req-ac714f84-b3d6-46d4-a3ec-617f7ad082ef service nova] Enqueued Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_members [ 825.174149] env[70006]: INFO networking_nsxv3.common.synchronization [req-564dc407-d78e-45ea-8729-ffc3de35dd31 req-ac714f84-b3d6-46d4-a3ec-617f7ad082ef service nova] Enqueued Resource ID: 6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230 with Priority: HIGHEST for action port [ 825.174836] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_rules [ 825.174836] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_members [ 825.174836] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230 with Priority: HIGHEST for action port [ 825.179028] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-745088da-b183-4222-8402-76e909adaab2 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.179028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.179028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.179028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.179028] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.179222] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-745088da-b183-4222-8402-76e909adaab2 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.179845] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.179845] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.179845] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.179845] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.180476] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.180544] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.182917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.182917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.183298] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.184639] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.184639] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.184796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.184849] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.184929] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.687600] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-745088da-b183-4222-8402-76e909adaab2 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.687758] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.687994] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.688953] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230 with status ACTIVE [ 825.689159] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.689295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.689399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.689665] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.689726] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.689920] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.690033] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.690097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.690275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.690355] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.690605] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.690710] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.690772] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.690914] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.690993] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.691116] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230 is going to be updated. [ 825.715260] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.715364] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.715417] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.715633] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.715770] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.715965] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6eb8e0b6-a88f-4ebb-b00f-2d3b86cf1230" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.194963] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.346813] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf in Status: SUCCESS [ 826.347111] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.347223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.347462] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.347657] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.347772] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.347838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.347995] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.348089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.348179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.348277] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.698166] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.698326] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.698401] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.698633] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.698729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.698825] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745088da-b183-4222-8402-76e909adaab2 is going to be created. [ 826.725098] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.725257] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.725322] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.725557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.725822] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.736626] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745088da-b183-4222-8402-76e909adaab2 in Status: UNINITIALIZED for 2s [ 826.852790] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.852790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.852790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.853041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.853237] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.853330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.853399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.853558] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.853666] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.853755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.853946] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.854077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.854141] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.854305] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.854449] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.854541] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.854601] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.854767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.854828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.854911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.855009] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.358092] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf: rpc.has_security_group_logging(os_id): False [ 827.377969] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.378195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.378239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.378488] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.378594] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.378787] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.378886] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.378947] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.379116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.379223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.379447] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.379547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.379652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.379814] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.379894] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.382074] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.384228] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.384310] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.384514] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.384575] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.384670] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf is going to be created. [ 827.445062] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.446652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.446652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.446652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.446652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.459829] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf in Status: IN_PROGRESS for 2s [ 828.480279] env[70006]: INFO networking_nsxv3.common.synchronization [req-564dc407-d78e-45ea-8729-ffc3de35dd31 req-84519bce-22ab-4c20-8cd5-c0f6b65309b0 tempest-ListServersNegativeTestJSON-1085704939 tempest-ListServersNegativeTestJSON-1085704939-project-member] Enqueued Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_members [ 828.480279] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_members [ 828.480947] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-745088da-b183-4222-8402-76e909adaab2 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.481210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.755509] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745088da-b183-4222-8402-76e909adaab2 in Status: SUCCESS [ 828.755509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.755509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.755509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.755509] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.755509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.755509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.755509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.755509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.755509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.755509] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.755509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.755509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.755509] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.755509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.755509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.756068] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.756068] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.756068] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.022782] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.022782] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-433" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.022782] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-433" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.022782] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-433" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.025450] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.025450] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.025673] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.025990] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.026208] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.028644] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.028644] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.028644] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.028644] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.028644] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.028644] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.028644] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.050970] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.051192] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 829.051338] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.052184] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-433" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.052184] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-addd72e9-8e61-463a-ab33-7872333bd242 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.052184] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-addd72e9-8e61-463a-ab33-7872333bd242" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.052427] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-addd72e9-8e61-463a-ab33-7872333bd242" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.052626] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-addd72e9-8e61-463a-ab33-7872333bd242" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.052778] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('addd72e9-8e61-463a-ab33-7872333bd242',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.258499] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-745088da-b183-4222-8402-76e909adaab2 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.258634] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.258837] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.472752] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf in Status: SUCCESS [ 829.473466] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.555840] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.556123] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.556202] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.556487] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.556651] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.556811] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port addd72e9-8e61-463a-ab33-7872333bd242 not found, creating... [ 829.557093] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.557262] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.557408] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.557656] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.557798] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.558103] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.558257] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.558417] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.558577] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.558742] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.558874] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: addd72e9-8e61-463a-ab33-7872333bd242 is going to be created. [ 829.581263] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.583319] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.583462] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.583743] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.583976] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.584232] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-addd72e9-8e61-463a-ab33-7872333bd242" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.765420] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.148545] env[70006]: INFO networking_nsxv3.common.synchronization [req-075d339e-ce86-4c64-8c82-fe6a32bc23f3 req-f6d786af-d947-4244-a82a-6c80ad603fec tempest-ImagesTestJSON-196229908 tempest-ImagesTestJSON-196229908-project-member] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 830.149128] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 830.149447] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.149576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.149621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.149824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.150010] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.151564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.151645] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.151835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.151975] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.152048] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.270625] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.274019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.274019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.274019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.274019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.274019] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745088da-b183-4222-8402-76e909adaab2 is going to be updated. [ 830.309035] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.309035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.309035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.309035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.309035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.319386] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745088da-b183-4222-8402-76e909adaab2 in Status: IN_PROGRESS for 2s [ 830.534571] env[70006]: INFO networking_nsxv3.common.synchronization [None req-f3d8f6bf-e72d-4f21-93d4-d74b1ef095c9 None None] Enqueued Resource ID: 7843e86a-564d-4f02-89de-619f1e533ae1 with Priority: HIGHEST for action port [ 830.535185] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7843e86a-564d-4f02-89de-619f1e533ae1 with Priority: HIGHEST for action port [ 830.535564] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-7843e86a-564d-4f02-89de-619f1e533ae1 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.536020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7843e86a-564d-4f02-89de-619f1e533ae1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.536020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7843e86a-564d-4f02-89de-619f1e533ae1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.536020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7843e86a-564d-4f02-89de-619f1e533ae1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.536214] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7843e86a-564d-4f02-89de-619f1e533ae1',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.607993] env[70006]: INFO networking_nsxv3.common.synchronization [req-564dc407-d78e-45ea-8729-ffc3de35dd31 req-81b9da19-85e3-4d42-9d3f-96b5457f6463 service nova] Enqueued Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_rules [ 830.608251] env[70006]: INFO networking_nsxv3.common.synchronization [req-564dc407-d78e-45ea-8729-ffc3de35dd31 req-81b9da19-85e3-4d42-9d3f-96b5457f6463 service nova] Enqueued Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_members [ 830.608329] env[70006]: INFO networking_nsxv3.common.synchronization [req-564dc407-d78e-45ea-8729-ffc3de35dd31 req-81b9da19-85e3-4d42-9d3f-96b5457f6463 service nova] Enqueued Resource ID: addd72e9-8e61-463a-ab33-7872333bd242 with Priority: HIGHEST for action port [ 830.608601] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_rules [ 830.608771] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_members [ 830.608876] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: addd72e9-8e61-463a-ab33-7872333bd242 with Priority: HIGHEST for action port [ 830.609908] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-745088da-b183-4222-8402-76e909adaab2 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.610042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.610576] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-745088da-b183-4222-8402-76e909adaab2 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.610576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.610766] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-addd72e9-8e61-463a-ab33-7872333bd242 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.610766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-addd72e9-8e61-463a-ab33-7872333bd242" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.610956] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-addd72e9-8e61-463a-ab33-7872333bd242" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.615039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-addd72e9-8e61-463a-ab33-7872333bd242" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.615039] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('addd72e9-8e61-463a-ab33-7872333bd242',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.657613] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.657613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.657613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.657613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.657613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.657613] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.657613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.657613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.657613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.657613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.657613] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be updated. [ 830.696551] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.696778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.696865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.698875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.698875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.707459] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: IN_PROGRESS for 2s [ 831.041616] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7843e86a-564d-4f02-89de-619f1e533ae1 [ 831.041821] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.041892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.041932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.042236] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.042351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.042443] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7843e86a-564d-4f02-89de-619f1e533ae1 already deleted. [ 831.042524] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7843e86a-564d-4f02-89de-619f1e533ae1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.120021] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port addd72e9-8e61-463a-ab33-7872333bd242 with status ACTIVE [ 831.120021] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.120021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.120021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.120021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.120021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.120021] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.120021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.120021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.120021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.120021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.120021] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.120021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.120021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.120021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.120021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.120021] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: addd72e9-8e61-463a-ab33-7872333bd242 is going to be updated. [ 831.154268] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.154413] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.154462] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.154677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.154810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.154969] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-addd72e9-8e61-463a-ab33-7872333bd242" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.329888] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745088da-b183-4222-8402-76e909adaab2 in Status: SUCCESS [ 832.330346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.330346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.330560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.330718] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.330842] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.330943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.331140] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.331221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.331311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.331651] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-745088da-b183-4222-8402-76e909adaab2 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.331651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.331651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.331781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.331880] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.332304] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.332893] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.332893] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.332893] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.332893] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.332893] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.333882] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.334239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.334408] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.334612] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.338179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.338386] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.338484] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.338584] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.474225] env[70006]: INFO networking_nsxv3.common.synchronization [None req-4dd4bd3e-7555-4309-8bea-2d2b7847c1f9 None None] Enqueued Resource ID: 0cc198c0-e256-4ee0-9ad5-35d0a65e2a2c with Priority: HIGHEST for action port [ 832.474796] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc198c0-e256-4ee0-9ad5-35d0a65e2a2c with Priority: HIGHEST for action port [ 832.475171] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cc198c0-e256-4ee0-9ad5-35d0a65e2a2c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.475339] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cc198c0-e256-4ee0-9ad5-35d0a65e2a2c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.475430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cc198c0-e256-4ee0-9ad5-35d0a65e2a2c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.475706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cc198c0-e256-4ee0-9ad5-35d0a65e2a2c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.475822] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cc198c0-e256-4ee0-9ad5-35d0a65e2a2c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.718282] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 832.718463] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 deletion is rescheduled due to dependency. [ 832.718573] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.841878] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 745088da-b183-4222-8402-76e909adaab2: rpc.has_security_group_logging(os_id): False [ 832.847808] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.868039] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.870618] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.871298] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.871298] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.871298] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.871298] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.871693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.871812] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.871993] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.872090] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.872292] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.872389] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.875034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.875034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.875034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.875034] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.875034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.875034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.875034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.875034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.875034] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 745088da-b183-4222-8402-76e909adaab2 is going to be created. [ 832.936174] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.937197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.937197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.937197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.937197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.949765] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 745088da-b183-4222-8402-76e909adaab2 in Status: IN_PROGRESS for 2s [ 832.979332] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0cc198c0-e256-4ee0-9ad5-35d0a65e2a2c [ 832.982035] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.982035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.982035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.982035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.982035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.982035] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0cc198c0-e256-4ee0-9ad5-35d0a65e2a2c already deleted. [ 832.982035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cc198c0-e256-4ee0-9ad5-35d0a65e2a2c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.349888] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.853826] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.854016] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.854128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.854304] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.854396] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.854494] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745088da-b183-4222-8402-76e909adaab2 is going to be updated. [ 833.885024] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.885024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.885024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.885195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.885274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.899412] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745088da-b183-4222-8402-76e909adaab2 in Status: IN_PROGRESS for 2s [ 834.499418] env[70006]: INFO networking_nsxv3.common.synchronization [None req-b44d8aaa-5a1c-47d0-a0ec-2f40d614ec12 None None] Enqueued Resource ID: 3e680ea3-6caa-44cc-9bfa-ac993950e3c6 with Priority: HIGHEST for action port [ 834.500541] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e680ea3-6caa-44cc-9bfa-ac993950e3c6 with Priority: HIGHEST for action port [ 834.501108] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e680ea3-6caa-44cc-9bfa-ac993950e3c6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.502097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e680ea3-6caa-44cc-9bfa-ac993950e3c6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.502266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e680ea3-6caa-44cc-9bfa-ac993950e3c6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.503331] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e680ea3-6caa-44cc-9bfa-ac993950e3c6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.503549] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e680ea3-6caa-44cc-9bfa-ac993950e3c6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.967979] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 745088da-b183-4222-8402-76e909adaab2 in Status: SUCCESS [ 834.967979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.967979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.967979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.967979] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.008260] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e680ea3-6caa-44cc-9bfa-ac993950e3c6 [ 835.008260] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.008260] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.009243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.009243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.009243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.009243] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e680ea3-6caa-44cc-9bfa-ac993950e3c6 already deleted. [ 835.009243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e680ea3-6caa-44cc-9bfa-ac993950e3c6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.277963] env[70006]: INFO networking_nsxv3.common.synchronization [req-0089690f-23b0-4732-92f3-92077d806479 req-0b8daea5-01b0-4901-9fc1-0dd77a2dfdb4 tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 835.278568] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 835.278934] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.279414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.279526] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.279789] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.279953] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.280133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.280222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.280380] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.280499] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.280594] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.471555] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-745088da-b183-4222-8402-76e909adaab2 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.471555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.585690] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.585690] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.585690] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.585690] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.585690] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.585690] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.587225] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.587413] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.587582] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.587814] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.587931] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.588952] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.588952] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.588952] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.588952] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.588952] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.609130] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.609355] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 835.609575] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.609803] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.610825] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-022596bd-d9fb-42f4-b6ee-29eb5192e817 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.610825] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-022596bd-d9fb-42f4-b6ee-29eb5192e817" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.610825] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-022596bd-d9fb-42f4-b6ee-29eb5192e817" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.611061] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-022596bd-d9fb-42f4-b6ee-29eb5192e817" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.611169] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('022596bd-d9fb-42f4-b6ee-29eb5192e817',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.782655] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.782801] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.782838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.783073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.783168] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.783357] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.783457] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.783530] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.783666] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.783740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.783822] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 already deleted. [ 835.783900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.910088] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745088da-b183-4222-8402-76e909adaab2 in Status: SUCCESS [ 835.910322] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.910527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.910754] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.910960] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.911103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.911172] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.911331] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.911434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.911520] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.911620] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.035124] env[70006]: INFO networking_nsxv3.common.synchronization [req-014975ae-bd14-4755-aa08-f63a6b977bb2 req-eb092031-376e-4ea9-a0fb-d60c6f3b2ffd tempest-SecurityGroupRulesNegativeTestJSON-657542610 tempest-SecurityGroupRulesNegativeTestJSON-657542610-project-member] Enqueued Resource ID: 0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32 with Priority: HIGHEST for action security_group_rules [ 836.036528] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32 with Priority: HIGHEST for action security_group_rules [ 836.036786] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.036912] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.036981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.037359] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.037500] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.114489] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.114726] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.114850] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.115153] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.115310] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.115464] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 022596bd-d9fb-42f4-b6ee-29eb5192e817 not found, creating... [ 836.115730] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.115885] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.116013] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.116517] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.116517] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.116652] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.116781] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.116900] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.117200] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.117343] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.117492] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 022596bd-d9fb-42f4-b6ee-29eb5192e817 is going to be created. [ 836.146503] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.146666] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.146812] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.147168] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.147443] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.147790] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-022596bd-d9fb-42f4-b6ee-29eb5192e817" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.416759] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-745088da-b183-4222-8402-76e909adaab2 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.416759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.416759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.416759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.416759] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.416759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.416759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.416759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.416759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.416759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.416759] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-745088da-b183-4222-8402-76e909adaab2 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.416759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.416759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.416759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.416759] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.416759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.417675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.417675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.417675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.417675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.417675] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.558632] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.558632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.558632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.558632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.558632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.558632] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32 already deleted. [ 836.558632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.658957] env[70006]: INFO networking_nsxv3.common.synchronization [None req-318c6d6f-f485-45aa-81f2-9766bcd6e9e0 None None] Enqueued Resource ID: 1fd0ef25-cf7a-435b-befb-caca296c192c with Priority: HIGHEST for action port [ 836.659259] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fd0ef25-cf7a-435b-befb-caca296c192c with Priority: HIGHEST for action port [ 836.659855] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fd0ef25-cf7a-435b-befb-caca296c192c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.663022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fd0ef25-cf7a-435b-befb-caca296c192c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.663022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fd0ef25-cf7a-435b-befb-caca296c192c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.663022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fd0ef25-cf7a-435b-befb-caca296c192c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.663022] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fd0ef25-cf7a-435b-befb-caca296c192c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.880502] env[70006]: INFO networking_nsxv3.common.synchronization [req-0089690f-23b0-4732-92f3-92077d806479 req-7743a438-80e4-4556-87a1-59b98a9fc904 service nova] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_rules [ 836.880502] env[70006]: INFO networking_nsxv3.common.synchronization [req-0089690f-23b0-4732-92f3-92077d806479 req-7743a438-80e4-4556-87a1-59b98a9fc904 service nova] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 836.880502] env[70006]: INFO networking_nsxv3.common.synchronization [req-0089690f-23b0-4732-92f3-92077d806479 req-7743a438-80e4-4556-87a1-59b98a9fc904 service nova] Enqueued Resource ID: 022596bd-d9fb-42f4-b6ee-29eb5192e817 with Priority: HIGHEST for action port [ 836.881098] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_rules [ 836.881163] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 836.881279] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 022596bd-d9fb-42f4-b6ee-29eb5192e817 with Priority: HIGHEST for action port [ 836.886547] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.886547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.886547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.886547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.886547] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.886547] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.886547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.886547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.886547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.886547] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.886547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.886547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.886547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.886547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.886547] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.886547] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-022596bd-d9fb-42f4-b6ee-29eb5192e817 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.886547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-022596bd-d9fb-42f4-b6ee-29eb5192e817" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.886547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-022596bd-d9fb-42f4-b6ee-29eb5192e817" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.887330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-022596bd-d9fb-42f4-b6ee-29eb5192e817" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.887330] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('022596bd-d9fb-42f4-b6ee-29eb5192e817',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.919626] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 745088da-b183-4222-8402-76e909adaab2: rpc.has_security_group_logging(os_id): False [ 836.968859] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.969071] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.969152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.969828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.969828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.969828] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.969828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.970090] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.970090] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.970173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.970327] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.970393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.970454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.971218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.971218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.971218] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.971400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.971400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.971576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.971679] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.972378] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 745088da-b183-4222-8402-76e909adaab2 is going to be updated. [ 837.018893] env[70006]: INFO networking_nsxv3.common.synchronization [req-a4ea97f6-4f61-463f-ab57-55e5b949fae8 req-bc436ff0-1155-450c-b453-c8cc7a3ef52e tempest-ListImageFiltersTestJSON-570141788 tempest-ListImageFiltersTestJSON-570141788-project-member] Enqueued Resource ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf with Priority: HIGHEST for action security_group_members [ 837.019593] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf with Priority: HIGHEST for action security_group_members [ 837.019593] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.019829] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.019829] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.019926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.020150] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.020150] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.020390] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.020390] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.020515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.020515] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.041485] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.041617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.041693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.041948] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.042058] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.059314] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 745088da-b183-4222-8402-76e909adaab2 in Status: IN_PROGRESS for 2s [ 837.165259] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fd0ef25-cf7a-435b-befb-caca296c192c [ 837.165618] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.165776] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.165912] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.166260] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.166433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.166594] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fd0ef25-cf7a-435b-befb-caca296c192c already deleted. [ 837.166753] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fd0ef25-cf7a-435b-befb-caca296c192c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.308403] env[70006]: INFO networking_nsxv3.common.synchronization [req-9d32dddf-e281-47c1-a88b-ebd96fccadea req-f7d19d86-8afd-4e80-a50d-6dc6fb1e3d8a tempest-SecurityGroupRulesNegativeTestJSON-657542610 tempest-SecurityGroupRulesNegativeTestJSON-657542610-project-member] Enqueued Resource ID: 0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32 with Priority: HIGHEST for action security_group_rules [ 837.309112] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32 with Priority: HIGHEST for action security_group_rules [ 837.309414] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.309604] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.309675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.309871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.309983] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.386772] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.386772] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.387501] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.389051] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 022596bd-d9fb-42f4-b6ee-29eb5192e817 with status ACTIVE [ 837.389051] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.389051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.389051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.389265] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.389295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.389807] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.389807] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.389807] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.389807] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.390025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.390177] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.390428] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.390536] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.390708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.390814] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.390922] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 022596bd-d9fb-42f4-b6ee-29eb5192e817 is going to be updated. [ 837.414742] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.414742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.414742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.414742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.414742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.414742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-022596bd-d9fb-42f4-b6ee-29eb5192e817" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.522829] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.523216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.523314] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.523563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.523671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.523939] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.524079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.524145] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.524322] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.524440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.524584] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf is going to be updated. [ 837.556866] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.556866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.556866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.556866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.556866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.567332] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf in Status: IN_PROGRESS for 2s [ 837.830394] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.830973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.830973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.830973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.830973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.831119] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32 already deleted. [ 837.831160] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e1b2f4c-bd2d-4b05-9ea5-e95b1b88ca32" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.893928] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.395644] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.395730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.395766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.395985] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.396091] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.396199] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be created. [ 838.422544] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.422774] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.422818] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.423035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.423219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.433564] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: UNINITIALIZED for 2s [ 839.073705] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 745088da-b183-4222-8402-76e909adaab2 in Status: SUCCESS [ 839.073705] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.101318] env[70006]: INFO networking_nsxv3.common.synchronization [req-564dc407-d78e-45ea-8729-ffc3de35dd31 req-748978b6-820d-4dfa-a7e1-1cb528b86123 tempest-ListServersNegativeTestJSON-1085704939 tempest-ListServersNegativeTestJSON-1085704939-project-member] Enqueued Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_members [ 839.101607] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_members [ 839.101905] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-745088da-b183-4222-8402-76e909adaab2 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.102046] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.102120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.102319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.102471] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.102567] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.102632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.102775] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.102860] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.102956] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.580202] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf in Status: SUCCESS [ 839.580202] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf deletion is rescheduled due to dependency. [ 839.580202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.605794] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.040964] env[70006]: INFO networking_nsxv3.common.synchronization [req-4271f021-9ea8-4a1f-bdeb-ceebd68d150c req-00e2297d-c3ea-4b5c-9282-1dcd924a286e tempest-ListServersNegativeTestJSON-1085704939 tempest-ListServersNegativeTestJSON-1085704939-project-member] Enqueued Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_members [ 840.041469] env[70006]: INFO networking_nsxv3.common.synchronization [None req-9178f5cb-3f9e-46e3-bcc9-acfcc444e331 tempest-AttachVolumeNegativeTest-242855104 tempest-AttachVolumeNegativeTest-242855104-project-member] Enqueued Resource ID: df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0 with Priority: HIGHEST for action security_group_rules [ 840.041947] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGHEST for action security_group_members [ 840.042098] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0 with Priority: HIGHEST for action security_group_rules [ 840.042383] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-745088da-b183-4222-8402-76e909adaab2 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.042487] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.042781] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.042781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.042930] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.043258] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.043258] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.108176] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.114677] env[70006]: INFO networking_nsxv3.common.synchronization [None req-efb3d561-92b5-43cf-9826-896a9fc50751 tempest-AttachVolumeNegativeTest-242855104 tempest-AttachVolumeNegativeTest-242855104-project-member] Enqueued Resource ID: df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0 with Priority: HIGHEST for action security_group_rules [ 840.115912] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0 with Priority: HIGHEST for action security_group_rules [ 840.116359] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.116509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.445393] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 840.445670] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.445846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.446140] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.446348] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.446505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.446586] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.446749] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.446834] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.446911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.447014] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.567880] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.568079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.568136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.568329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.568421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.568524] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0 already deleted. [ 840.568604] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.568778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.568909] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.569095] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.610062] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.610203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.610312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.610468] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.610559] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.610754] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745088da-b183-4222-8402-76e909adaab2 is going to be updated. [ 840.640241] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.640430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.640526] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.640859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.641105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.651157] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745088da-b183-4222-8402-76e909adaab2 in Status: IN_PROGRESS for 2s [ 840.950114] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.950319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.950398] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.950653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.950833] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.950972] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.951076] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.952683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.952683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.952683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.952683] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.952683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.952683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.952683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.952683] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.952683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.952683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.952683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.952683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.952683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.953182] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.091591] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.092350] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.092350] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.092599] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.092907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.092907] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0 already deleted. [ 841.092997] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df6b60a9-7db7-4bc2-a5a6-72eeb00ec4d0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.456859] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcb3911f-9d2b-45be-a214-581dc745aaa9: rpc.has_security_group_logging(os_id): False [ 841.475593] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.475951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.475951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.476159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.476263] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.476525] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.476603] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.476700] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.476874] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.476976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.477205] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.477320] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.477423] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.477591] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.477684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.478034] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.478034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.478899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.479092] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.479261] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.479316] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be created. [ 841.540810] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.541013] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.541013] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.541229] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.541414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.553348] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 842.661708] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745088da-b183-4222-8402-76e909adaab2 in Status: SUCCESS [ 842.661945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.662121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.662331] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.662522] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.662643] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.662710] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.662869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.662956] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.663063] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.166014] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.166182] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.166182] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.166438] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.166503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.166703] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.166877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.166877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.167023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.167220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.167220] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745088da-b183-4222-8402-76e909adaab2 is going to be updated. [ 843.199467] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.199467] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.199467] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.199705] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.199856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.208834] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745088da-b183-4222-8402-76e909adaab2 in Status: IN_PROGRESS for 2s [ 843.572240] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 843.572388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.116875] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 845.116875] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 845.219883] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745088da-b183-4222-8402-76e909adaab2 in Status: SUCCESS [ 845.220097] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745088da-b183-4222-8402-76e909adaab2 deletion is rescheduled due to dependency. [ 845.220223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.891391] env[70006]: INFO networking_nsxv3.common.synchronization [None req-6216bbfa-6af5-4aa1-9de1-85f74a820c31 None None] Enqueued Resource ID: 55c0a13d-a4f3-40ea-b40c-ab3ae0a62537 with Priority: HIGHEST for action port [ 846.891391] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55c0a13d-a4f3-40ea-b40c-ab3ae0a62537 with Priority: HIGHEST for action port [ 846.891391] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-55c0a13d-a4f3-40ea-b40c-ab3ae0a62537 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.891391] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55c0a13d-a4f3-40ea-b40c-ab3ae0a62537" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.891391] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55c0a13d-a4f3-40ea-b40c-ab3ae0a62537" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.893759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55c0a13d-a4f3-40ea-b40c-ab3ae0a62537" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.893759] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55c0a13d-a4f3-40ea-b40c-ab3ae0a62537',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.394485] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55c0a13d-a4f3-40ea-b40c-ab3ae0a62537 [ 847.394741] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.394928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.394971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.395179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.395285] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.395384] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55c0a13d-a4f3-40ea-b40c-ab3ae0a62537 already deleted. [ 847.395465] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55c0a13d-a4f3-40ea-b40c-ab3ae0a62537" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.455778] env[70006]: INFO networking_nsxv3.common.synchronization [req-cd51f2f5-2a44-4e15-8b5d-03f66db98006 req-52512ffa-0c87-4468-972e-3efd3784a891 tempest-ServersTestJSON-1431904245 tempest-ServersTestJSON-1431904245-project-member] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 847.456492] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 847.456966] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.456966] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.456966] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.457190] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.457348] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.457435] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.457499] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.457687] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.458264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.458264] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.960108] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.114630] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.116376] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.116376] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.116376] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.116376] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.116376] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.116886] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.116886] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.117035] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.117220] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.117327] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.118106] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.118106] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.118106] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.118106] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.118255] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.138475] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.138805] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 848.138805] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.138934] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.139267] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-c0c18e7a-0f35-4d2e-b12d-0002001b6793 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.139435] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-c0c18e7a-0f35-4d2e-b12d-0002001b6793" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.139845] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-c0c18e7a-0f35-4d2e-b12d-0002001b6793" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.139929] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-c0c18e7a-0f35-4d2e-b12d-0002001b6793" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.140049] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0c18e7a-0f35-4d2e-b12d-0002001b6793',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.410822] env[70006]: INFO networking_nsxv3.common.synchronization [None req-3024c824-d6bc-4bb8-8470-e2616b2f809f tempest-ServersTestManualDisk-1390980805 tempest-ServersTestManualDisk-1390980805-project-member] Enqueued Resource ID: ef74a163-93f9-4f62-8b62-474b25356f5e with Priority: HIGHEST for action security_group_rules [ 848.411353] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef74a163-93f9-4f62-8b62-474b25356f5e with Priority: HIGHEST for action security_group_rules [ 848.411663] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef74a163-93f9-4f62-8b62-474b25356f5e taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.411781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef74a163-93f9-4f62-8b62-474b25356f5e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.415518] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef74a163-93f9-4f62-8b62-474b25356f5e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.415891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef74a163-93f9-4f62-8b62-474b25356f5e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.416166] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef74a163-93f9-4f62-8b62-474b25356f5e',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.463158] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.508208] env[70006]: INFO networking_nsxv3.common.synchronization [None req-79f2d244-681d-489f-adea-06eb93910d38 tempest-ServersTestManualDisk-1390980805 tempest-ServersTestManualDisk-1390980805-project-member] Enqueued Resource ID: ef74a163-93f9-4f62-8b62-474b25356f5e with Priority: HIGHEST for action security_group_rules [ 848.509769] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef74a163-93f9-4f62-8b62-474b25356f5e with Priority: HIGHEST for action security_group_rules [ 848.511053] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef74a163-93f9-4f62-8b62-474b25356f5e taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.511053] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef74a163-93f9-4f62-8b62-474b25356f5e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.642152] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.643405] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.646018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.646018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.646018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.646018] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port c0c18e7a-0f35-4d2e-b12d-0002001b6793 not found, creating... [ 848.646018] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.646018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.646018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.646018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.646018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.646018] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.646451] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.646451] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.646451] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.646889] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.648210] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: c0c18e7a-0f35-4d2e-b12d-0002001b6793 is going to be created. [ 848.669964] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.670206] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.670206] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.670496] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.670758] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.670987] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-c0c18e7a-0f35-4d2e-b12d-0002001b6793" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.824763] env[70006]: INFO networking_nsxv3.common.synchronization [None req-3ba11232-4fda-4f60-9de2-516440599c49 None None] Enqueued Resource ID: 15cceb4a-15db-4e41-a566-0cdcbbe2fd90 with Priority: HIGHEST for action port [ 848.825610] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cceb4a-15db-4e41-a566-0cdcbbe2fd90 with Priority: HIGHEST for action port [ 848.825975] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-15cceb4a-15db-4e41-a566-0cdcbbe2fd90 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.827070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15cceb4a-15db-4e41-a566-0cdcbbe2fd90" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.827070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15cceb4a-15db-4e41-a566-0cdcbbe2fd90" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.827070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15cceb4a-15db-4e41-a566-0cdcbbe2fd90" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.827070] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15cceb4a-15db-4e41-a566-0cdcbbe2fd90',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.946078] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.946078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.946078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.946078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.946078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.946078] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef74a163-93f9-4f62-8b62-474b25356f5e already deleted. [ 848.946078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef74a163-93f9-4f62-8b62-474b25356f5e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.946078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef74a163-93f9-4f62-8b62-474b25356f5e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.946078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef74a163-93f9-4f62-8b62-474b25356f5e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.946078] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef74a163-93f9-4f62-8b62-474b25356f5e',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.965923] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.966205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.966205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.966350] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.966491] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.966535] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 848.999791] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.999791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.000020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.000068] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.000219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.019178] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 849.329976] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15cceb4a-15db-4e41-a566-0cdcbbe2fd90 [ 849.330254] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.330392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.330462] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.330818] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.330933] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.331054] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15cceb4a-15db-4e41-a566-0cdcbbe2fd90 already deleted. [ 849.331182] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15cceb4a-15db-4e41-a566-0cdcbbe2fd90" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.374269] env[70006]: INFO networking_nsxv3.common.synchronization [req-cd51f2f5-2a44-4e15-8b5d-03f66db98006 req-8002d82e-adc7-4eea-88a3-0c08f91439fb service nova] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_rules [ 849.374269] env[70006]: INFO networking_nsxv3.common.synchronization [req-cd51f2f5-2a44-4e15-8b5d-03f66db98006 req-8002d82e-adc7-4eea-88a3-0c08f91439fb service nova] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 849.374269] env[70006]: INFO networking_nsxv3.common.synchronization [req-cd51f2f5-2a44-4e15-8b5d-03f66db98006 req-8002d82e-adc7-4eea-88a3-0c08f91439fb service nova] Enqueued Resource ID: c0c18e7a-0f35-4d2e-b12d-0002001b6793 with Priority: HIGHEST for action port [ 849.374269] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_rules [ 849.374507] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 849.374507] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c18e7a-0f35-4d2e-b12d-0002001b6793 with Priority: HIGHEST for action port [ 849.375624] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.375624] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.375901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.375901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.375966] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.376817] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.376914] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.377112] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0c18e7a-0f35-4d2e-b12d-0002001b6793 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.377213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0c18e7a-0f35-4d2e-b12d-0002001b6793" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.377277] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0c18e7a-0f35-4d2e-b12d-0002001b6793" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.377439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0c18e7a-0f35-4d2e-b12d-0002001b6793" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.377536] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0c18e7a-0f35-4d2e-b12d-0002001b6793',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.476070] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.476070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.476070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.476070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.476294] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.476294] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef74a163-93f9-4f62-8b62-474b25356f5e already deleted. [ 849.476350] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef74a163-93f9-4f62-8b62-474b25356f5e" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.709848] env[70006]: INFO networking_nsxv3.common.synchronization [req-33ee1a00-f4c4-4335-94fa-cf0331b5eff2 req-d057f734-924f-481c-93e1-105e55ee2405 tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 849.710614] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 849.711122] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.711254] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.711332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.711593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.711767] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.711872] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.711936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.712106] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.712191] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.712327] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.796144] env[70006]: INFO networking_nsxv3.common.synchronization [req-7351bf78-7314-4b32-b445-e10a6c3f3d6b req-75c1f555-1c47-414e-b98b-d82543704b64 tempest-VolumesAdminNegativeTest-932475284 tempest-VolumesAdminNegativeTest-932475284-project-member] Enqueued Resource ID: 598ac99e-7479-4d78-948d-bd3f771adf65 with Priority: HIGHEST for action security_group_members [ 849.796144] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 598ac99e-7479-4d78-948d-bd3f771adf65 with Priority: HIGHEST for action security_group_members [ 849.796144] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-598ac99e-7479-4d78-948d-bd3f771adf65 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.796144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.796144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.796144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.796144] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.796144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.796144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.796144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.796144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.797734] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('598ac99e-7479-4d78-948d-bd3f771adf65',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.879235] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.879363] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.879571] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0c18e7a-0f35-4d2e-b12d-0002001b6793 with status ACTIVE [ 849.879756] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.879862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.879928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.880163] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.880256] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.880422] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.880516] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.880599] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.880769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.880854] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.881051] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.884116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.884116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.884116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.884116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.884116] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0c18e7a-0f35-4d2e-b12d-0002001b6793 is going to be updated. [ 849.906751] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.906901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.907017] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.907258] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.907556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.907626] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0c18e7a-0f35-4d2e-b12d-0002001b6793" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.214614] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.214893] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.214893] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.215090] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.215249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.215395] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.215517] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.215597] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.215764] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.215871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.215931] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be updated. [ 850.258965] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.258965] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.259334] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.259334] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.259476] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.269659] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 850.300810] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.301027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.301120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.301387] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.301513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.301766] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.302067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.302067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.303750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.303750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.303750] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 598ac99e-7479-4d78-948d-bd3f771adf65 already deleted. [ 850.303750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.349827] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.350024] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-34" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.350157] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-34" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.350422] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-34" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.350710] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.350873] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.350990] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.351234] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.351382] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.351591] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 850.351705] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.351814] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.351923] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.352040] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 850.352146] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.352275] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.370699] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.370903] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 850.371054] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.371257] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-34" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.371571] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-84120f9b-ce4d-4d5a-9090-faca58cc4f6a taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.371741] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-84120f9b-ce4d-4d5a-9090-faca58cc4f6a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.371863] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-84120f9b-ce4d-4d5a-9090-faca58cc4f6a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.372240] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-84120f9b-ce4d-4d5a-9090-faca58cc4f6a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.372385] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84120f9b-ce4d-4d5a-9090-faca58cc4f6a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.878081] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.878081] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.878081] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.878081] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.878081] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.878081] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 84120f9b-ce4d-4d5a-9090-faca58cc4f6a not found, creating... [ 850.878081] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.878081] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.878081] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.879540] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.879946] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.880890] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.881321] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.881562] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.881887] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.882147] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.882385] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 84120f9b-ce4d-4d5a-9090-faca58cc4f6a is going to be created. [ 850.908606] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.908606] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.908606] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.908606] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.908606] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.908606] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-84120f9b-ce4d-4d5a-9090-faca58cc4f6a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.030795] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 851.031084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.031279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.031499] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.031690] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.031813] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.032665] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.034157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.034279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.034385] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.539236] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.828409] env[70006]: INFO networking_nsxv3.common.synchronization [req-7351bf78-7314-4b32-b445-e10a6c3f3d6b req-42f4bdfc-8fc9-41c9-82c4-1323049bc357 service nova] Enqueued Resource ID: 598ac99e-7479-4d78-948d-bd3f771adf65 with Priority: HIGHEST for action security_group_rules [ 851.828409] env[70006]: INFO networking_nsxv3.common.synchronization [req-7351bf78-7314-4b32-b445-e10a6c3f3d6b req-42f4bdfc-8fc9-41c9-82c4-1323049bc357 service nova] Enqueued Resource ID: 598ac99e-7479-4d78-948d-bd3f771adf65 with Priority: HIGHEST for action security_group_members [ 851.828409] env[70006]: INFO networking_nsxv3.common.synchronization [req-7351bf78-7314-4b32-b445-e10a6c3f3d6b req-42f4bdfc-8fc9-41c9-82c4-1323049bc357 service nova] Enqueued Resource ID: 84120f9b-ce4d-4d5a-9090-faca58cc4f6a with Priority: HIGHEST for action port [ 851.828409] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 598ac99e-7479-4d78-948d-bd3f771adf65 with Priority: HIGHEST for action security_group_rules [ 851.828409] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 598ac99e-7479-4d78-948d-bd3f771adf65 with Priority: HIGHEST for action security_group_members [ 851.828409] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84120f9b-ce4d-4d5a-9090-faca58cc4f6a with Priority: HIGHEST for action port [ 851.828823] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-598ac99e-7479-4d78-948d-bd3f771adf65 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.829134] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.829334] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.829695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.829966] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('598ac99e-7479-4d78-948d-bd3f771adf65',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.832761] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-598ac99e-7479-4d78-948d-bd3f771adf65 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.832761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.832761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.832761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.832761] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.832761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.832761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.832761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.833730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.833829] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('598ac99e-7479-4d78-948d-bd3f771adf65',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.836085] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-84120f9b-ce4d-4d5a-9090-faca58cc4f6a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.836085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84120f9b-ce4d-4d5a-9090-faca58cc4f6a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.836085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84120f9b-ce4d-4d5a-9090-faca58cc4f6a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.836085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84120f9b-ce4d-4d5a-9090-faca58cc4f6a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.836085] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84120f9b-ce4d-4d5a-9090-faca58cc4f6a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.042985] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.285195] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 852.285195] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 deletion is rescheduled due to dependency. [ 852.285366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.336881] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('598ac99e-7479-4d78-948d-bd3f771adf65',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.337748] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-598ac99e-7479-4d78-948d-bd3f771adf65 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.337909] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.338026] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84120f9b-ce4d-4d5a-9090-faca58cc4f6a with status ACTIVE [ 852.338181] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.338312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.338380] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.338542] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.341988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.341988] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.341988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.341988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.341988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.341988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.341988] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.341988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.341988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.341988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.341988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.341988] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84120f9b-ce4d-4d5a-9090-faca58cc4f6a is going to be updated. [ 852.366167] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.366321] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.366394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.366613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.366750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.366913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84120f9b-ce4d-4d5a-9090-faca58cc4f6a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.549343] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.549740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.549740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.550019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.550147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.550255] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 852.589127] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.589311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.589432] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.589568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.589756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.600179] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 852.842815] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('598ac99e-7479-4d78-948d-bd3f771adf65',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.893989] env[70006]: INFO networking_nsxv3.common.synchronization [req-995a6614-e604-4d06-9435-13abb3f05f88 req-008611e1-2f5d-4c85-8940-d662c32122fe tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: cefeff63-e154-425d-8ffe-56cc092db146 with Priority: HIGHEST for action security_group_members [ 852.894597] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cefeff63-e154-425d-8ffe-56cc092db146 with Priority: HIGHEST for action security_group_members [ 852.894924] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cefeff63-e154-425d-8ffe-56cc092db146 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.896121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.896724] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.897522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.897522] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.897522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.897522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.897522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.897998] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.897998] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cefeff63-e154-425d-8ffe-56cc092db146',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.345276] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.345512] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.345512] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.345735] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.345832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.345945] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 598ac99e-7479-4d78-948d-bd3f771adf65 is going to be created. [ 853.376405] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.376672] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.376672] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.376954] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.377081] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.391064] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 598ac99e-7479-4d78-948d-bd3f771adf65 in Status: UNINITIALIZED for 2s [ 853.399940] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.400161] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.400161] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.400392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.400516] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.400720] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.400828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.400904] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.401061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.401151] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.401243] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cefeff63-e154-425d-8ffe-56cc092db146 is going to be updated. [ 853.437274] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.437431] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.438063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.438063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.438063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.449368] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cefeff63-e154-425d-8ffe-56cc092db146 in Status: IN_PROGRESS for 2s [ 854.062320] env[70006]: INFO networking_nsxv3.common.synchronization [req-edb1ed35-5bf2-44f3-9128-c98e6322c7af req-d0d589af-15dc-4739-bf39-0b8242d74261 tempest-InstanceActionsTestJSON-1929193662 tempest-InstanceActionsTestJSON-1929193662-project-member] Enqueued Resource ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c with Priority: HIGHEST for action security_group_members [ 854.063072] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c with Priority: HIGHEST for action security_group_members [ 854.064088] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.064088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.064088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.064287] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.064372] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.064479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.064545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.064705] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.064792] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.064889] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.566939] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.567104] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.567199] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.567601] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.567717] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.568565] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.568565] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.568565] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.568565] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.568726] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.568726] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c already deleted. [ 854.568786] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.613189] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 854.613189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.613189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.613189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.613189] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.613189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.613189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.613189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.613189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.613189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.613189] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.728696] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-363 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.728877] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-363" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.729006] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-363" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.729329] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-363" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.729585] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.729773] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.729893] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.730282] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.730432] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.730649] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 854.730782] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.730896] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.731082] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.731126] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 854.731233] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.731365] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.753609] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.753609] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 854.753609] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.753609] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-363" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.753609] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.753609] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.753609] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.753928] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.754146] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.115816] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.116171] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.116171] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.116306] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.116544] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.116658] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.116769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.116961] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.117216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.117386] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.118624] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.118624] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.118624] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.118624] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.118624] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.118624] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.118624] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.118624] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.118624] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.118624] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.118920] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.257201] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.259886] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.259886] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.259886] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.259886] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.259886] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2 not found, creating... [ 855.259886] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.259886] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.259886] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.259886] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.259886] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.260250] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.260250] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.260250] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.260250] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.260386] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.260458] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2 is going to be created. [ 855.286393] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.287630] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.287630] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.287630] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.287630] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.287630] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.403152] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 598ac99e-7479-4d78-948d-bd3f771adf65 in Status: SUCCESS [ 855.403309] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.403372] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.403589] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.403825] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.403934] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.403998] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.404182] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.405497] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.405497] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.405497] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('598ac99e-7479-4d78-948d-bd3f771adf65',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.460904] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cefeff63-e154-425d-8ffe-56cc092db146 in Status: SUCCESS [ 855.461094] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cefeff63-e154-425d-8ffe-56cc092db146 deletion is rescheduled due to dependency. [ 855.461218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.625697] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b2723f9-b1dc-419e-b339-13aae985829f: rpc.has_security_group_logging(os_id): False [ 855.643960] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.644141] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.644218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.644433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.644529] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.644720] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.644868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.644975] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.645217] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.645313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.645525] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.645608] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.645679] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.645817] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.645892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.648589] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.648767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.648840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.649023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.649142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.649226] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 855.731419] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.731618] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.731680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.731903] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.732154] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.746966] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 855.910407] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-598ac99e-7479-4d78-948d-bd3f771adf65 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.910576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.910651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.910886] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.911066] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.911168] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.911233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.911399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.911476] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.911563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.911710] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-598ac99e-7479-4d78-948d-bd3f771adf65 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.911807] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.911857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.912013] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.914224] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.914403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.914485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.914668] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.914767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.914864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.914964] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('598ac99e-7479-4d78-948d-bd3f771adf65',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.156631] env[70006]: INFO networking_nsxv3.common.synchronization [req-edb1ed35-5bf2-44f3-9128-c98e6322c7af req-b48545db-25c0-4c27-b42b-e552c489ab6d service nova] Enqueued Resource ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c with Priority: HIGHEST for action security_group_rules [ 856.156963] env[70006]: INFO networking_nsxv3.common.synchronization [req-edb1ed35-5bf2-44f3-9128-c98e6322c7af req-b48545db-25c0-4c27-b42b-e552c489ab6d service nova] Enqueued Resource ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c with Priority: HIGHEST for action security_group_members [ 856.157131] env[70006]: INFO networking_nsxv3.common.synchronization [req-edb1ed35-5bf2-44f3-9128-c98e6322c7af req-b48545db-25c0-4c27-b42b-e552c489ab6d service nova] Enqueued Resource ID: 3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2 with Priority: HIGHEST for action port [ 856.157885] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c with Priority: HIGHEST for action security_group_rules [ 856.158072] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c with Priority: HIGHEST for action security_group_members [ 856.158210] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2 with Priority: HIGHEST for action port [ 856.158686] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.158880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.158979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.159407] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.159508] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.160964] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.164199] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.164316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.164823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.164823] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.164823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.164988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.165095] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.166873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.166873] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.166873] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.166873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.166873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.166873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.166873] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.418028] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 598ac99e-7479-4d78-948d-bd3f771adf65: rpc.has_security_group_logging(os_id): False [ 856.437796] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.437796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.437796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.437984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.437984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.438186] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.438259] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.438414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.438482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.438536] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.438774] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.438895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.438895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.439082] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.439082] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.439375] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.439375] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.439375] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.439523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.439581] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.439694] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 598ac99e-7479-4d78-948d-bd3f771adf65 is going to be created. [ 856.515160] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.515349] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.515448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.515687] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.516402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.532242] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 598ac99e-7479-4d78-948d-bd3f771adf65 in Status: IN_PROGRESS for 2s [ 856.669933] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.670136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.670399] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.672107] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2 with status ACTIVE [ 856.672360] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.672449] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.672503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.672975] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.673085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.673793] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.673793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.673793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.673793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.673793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.674099] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.674099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.674099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.674399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.674399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.674399] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2 is going to be updated. [ 856.700230] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.700230] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.700230] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.700230] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.700932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.701146] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b0bd58d-e108-46ac-8fc1-5eeda2eb17e2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.173160] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.676145] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.676447] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.676518] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.676916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.676916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.676916] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c is going to be created. [ 857.703970] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.704415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.704415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.704531] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.705401] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.717729] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c in Status: UNINITIALIZED for 2s [ 857.759580] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 857.761612] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.546999] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 598ac99e-7479-4d78-948d-bd3f771adf65 in Status: SUCCESS [ 858.547352] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.043904] env[70006]: INFO networking_nsxv3.common.synchronization [req-7a7758f9-42cd-480a-b234-c949878378ca req-e00ecda6-d2fc-46e5-83c8-6f37d7a04dd0 tempest-ServersWithSpecificFlavorTestJSON-1233962006 tempest-ServersWithSpecificFlavorTestJSON-1233962006-project-member] Enqueued Resource ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 with Priority: HIGHEST for action security_group_members [ 859.043904] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 with Priority: HIGHEST for action security_group_members [ 859.043904] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.043904] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.043904] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.044192] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.044192] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.044332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.044332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.045039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.045039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.045039] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('caa33f7e-8d3a-4a22-985b-0a592f9b03a1',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.548074] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.548311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.548346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.548651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.548651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.548830] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.548922] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.548983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.549147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.549267] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.549312] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 is going to be updated. [ 859.578070] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.578235] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.578288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.579959] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.579959] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.588446] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 in Status: IN_PROGRESS for 2s [ 859.728717] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c in Status: SUCCESS [ 859.728948] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.729139] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.729363] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.729555] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.729688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.729754] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.729922] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.730022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.730111] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.730221] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.235282] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.235491] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.235491] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.235891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.235891] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.236098] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.236098] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.236423] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.236423] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.236423] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.236564] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.236616] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.236660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.237024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.237024] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.237024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.237216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.237216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.237300] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.238655] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.238798] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.558777] env[70006]: INFO networking_nsxv3.common.synchronization [req-b1dcdbfa-4126-4acb-b76e-4b87e0f7ede0 req-b16238af-78e4-40cf-be35-37ff5911ec97 tempest-ServersTestJSON-1431904245 tempest-ServersTestJSON-1431904245-project-member] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 860.559389] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 860.559872] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.560036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.560110] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.560338] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.560490] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.560602] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.560690] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.560863] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.560966] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.561071] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.746019] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c: rpc.has_security_group_logging(os_id): False [ 860.764158] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.767157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.767157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.767157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.767157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.767157] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.767157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.767157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.767157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.767157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.767157] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.767157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.767157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.767157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.767157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.767800] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.768042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.768205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.768431] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.768621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.768835] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c is going to be created. [ 860.829021] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.829021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.829021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.829021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.829021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.838874] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c in Status: IN_PROGRESS for 2s [ 861.064291] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.571558] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.600670] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 in Status: SUCCESS [ 861.601705] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 deletion is rescheduled due to dependency. [ 861.601705] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.856254] env[70006]: INFO networking_nsxv3.common.synchronization [req-def78012-ddff-452e-a904-9121671cbcb1 req-91680109-970c-42ff-baf0-0f7d4392ca54 tempest-ServersAdminTestJSON-372282544 tempest-ServersAdminTestJSON-372282544-project-member] Enqueued Resource ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 with Priority: HIGHEST for action security_group_members [ 861.858049] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 with Priority: HIGHEST for action security_group_members [ 861.858049] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.858049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.858049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.858049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.858049] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.858049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.858049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.858614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.858614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.859644] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd192c2d-795f-4fff-bacc-dc0eb6d345b8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.070795] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.071029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.071111] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.071394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.071497] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.071606] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 862.099452] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.099617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.099740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.100078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.100208] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.110328] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 862.364227] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.364401] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.364475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.365482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.365482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.365482] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.365482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.365482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.365482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.365482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.365805] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 already deleted. [ 862.365872] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.368708] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-743 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.368931] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-743" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.369103] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-743" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.369627] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-743" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.369977] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.370219] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.370452] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.370721] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.370935] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.371254] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.371473] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.371616] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.371755] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.371909] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.372106] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.372295] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.396650] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.396745] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 862.396883] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.397080] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-743" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.397418] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-f3add360-018f-4a8b-9a58-1a47a83f2bc4 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.397793] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-f3add360-018f-4a8b-9a58-1a47a83f2bc4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.397927] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-f3add360-018f-4a8b-9a58-1a47a83f2bc4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.398514] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-f3add360-018f-4a8b-9a58-1a47a83f2bc4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.398514] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3add360-018f-4a8b-9a58-1a47a83f2bc4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.855975] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c in Status: SUCCESS [ 862.855975] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.893832] env[70006]: INFO networking_nsxv3.common.synchronization [None req-18ece687-db3e-40a0-93d2-f8df05bc0acd None None] Enqueued Resource ID: fd89e33e-86c8-45ff-a05b-4600edd53f31 with Priority: HIGHEST for action port [ 862.897259] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd89e33e-86c8-45ff-a05b-4600edd53f31 with Priority: HIGHEST for action port [ 862.898871] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd89e33e-86c8-45ff-a05b-4600edd53f31 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.901861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd89e33e-86c8-45ff-a05b-4600edd53f31" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.901861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd89e33e-86c8-45ff-a05b-4600edd53f31" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.901861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd89e33e-86c8-45ff-a05b-4600edd53f31" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.901861] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd89e33e-86c8-45ff-a05b-4600edd53f31',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.903558] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.904019] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.904307] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.904732] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.905025] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.905745] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port f3add360-018f-4a8b-9a58-1a47a83f2bc4 not found, creating... [ 862.905877] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.906070] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.906210] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.906477] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.906717] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.907190] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.907349] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.907486] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.907718] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.907859] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.908032] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: f3add360-018f-4a8b-9a58-1a47a83f2bc4 is going to be created. [ 862.936080] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.936080] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.936080] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.936080] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.936080] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.936080] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-f3add360-018f-4a8b-9a58-1a47a83f2bc4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.405408] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd89e33e-86c8-45ff-a05b-4600edd53f31 [ 863.405666] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.405830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.405899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.406245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.406303] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.407632] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd89e33e-86c8-45ff-a05b-4600edd53f31 already deleted. [ 863.407632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd89e33e-86c8-45ff-a05b-4600edd53f31" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.671211] env[70006]: INFO networking_nsxv3.common.synchronization [req-5ac79e0c-6557-4fed-83ca-3c5994e02748 req-bce9ca3e-a619-46a3-a4f1-2bc085c24939 tempest-ServerActionsV293TestJSON-630636606 tempest-ServerActionsV293TestJSON-630636606-project-member] Enqueued Resource ID: b62110f9-4181-4c43-9e99-43fd5dff214d with Priority: HIGHEST for action security_group_members [ 863.671211] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62110f9-4181-4c43-9e99-43fd5dff214d with Priority: HIGHEST for action security_group_members [ 863.671429] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62110f9-4181-4c43-9e99-43fd5dff214d taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.671615] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.671615] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.671798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.671942] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.672061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.672127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.672277] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.672369] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.672455] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62110f9-4181-4c43-9e99-43fd5dff214d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.693750] env[70006]: INFO networking_nsxv3.common.synchronization [req-def78012-ddff-452e-a904-9121671cbcb1 req-69645e98-e580-4212-8012-431384d7e9c2 service nova] Enqueued Resource ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 with Priority: HIGHEST for action security_group_rules [ 863.693912] env[70006]: INFO networking_nsxv3.common.synchronization [req-def78012-ddff-452e-a904-9121671cbcb1 req-69645e98-e580-4212-8012-431384d7e9c2 service nova] Enqueued Resource ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 with Priority: HIGHEST for action security_group_members [ 863.694067] env[70006]: INFO networking_nsxv3.common.synchronization [req-def78012-ddff-452e-a904-9121671cbcb1 req-69645e98-e580-4212-8012-431384d7e9c2 service nova] Enqueued Resource ID: f3add360-018f-4a8b-9a58-1a47a83f2bc4 with Priority: HIGHEST for action port [ 863.694615] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 with Priority: HIGHEST for action security_group_rules [ 863.694781] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 with Priority: HIGHEST for action security_group_members [ 863.695435] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3add360-018f-4a8b-9a58-1a47a83f2bc4 with Priority: HIGHEST for action port [ 863.697761] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd192c2d-795f-4fff-bacc-dc0eb6d345b8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.697942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.698029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.698272] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.698358] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd192c2d-795f-4fff-bacc-dc0eb6d345b8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.702781] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.702781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.702781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.702781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.702781] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.702781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.702781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.702781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.702781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.702781] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd192c2d-795f-4fff-bacc-dc0eb6d345b8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.703959] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3add360-018f-4a8b-9a58-1a47a83f2bc4 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.704102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3add360-018f-4a8b-9a58-1a47a83f2bc4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.704169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3add360-018f-4a8b-9a58-1a47a83f2bc4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.704357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3add360-018f-4a8b-9a58-1a47a83f2bc4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.704448] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3add360-018f-4a8b-9a58-1a47a83f2bc4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.123865] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 864.124163] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.177051] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.177159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.177200] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.177443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.177540] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.177979] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.178145] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.178246] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.178497] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.178631] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.178769] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62110f9-4181-4c43-9e99-43fd5dff214d is going to be updated. [ 864.206376] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd192c2d-795f-4fff-bacc-dc0eb6d345b8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.209748] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.209748] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.212299] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3add360-018f-4a8b-9a58-1a47a83f2bc4 with status ACTIVE [ 864.212528] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.212657] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.212718] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.212990] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.213156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.213402] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.213992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.213992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.213992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.213992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.213992] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.214292] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.214292] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.214292] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.214507] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.214507] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3add360-018f-4a8b-9a58-1a47a83f2bc4 is going to be updated. [ 864.216532] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.216699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.216699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.216875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.216983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.231070] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62110f9-4181-4c43-9e99-43fd5dff214d in Status: IN_PROGRESS for 2s [ 864.240491] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.240646] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.242147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.242147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.242147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.242147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3add360-018f-4a8b-9a58-1a47a83f2bc4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.708615] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd192c2d-795f-4fff-bacc-dc0eb6d345b8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.809368] env[70006]: INFO networking_nsxv3.common.synchronization [req-cfbaee93-5218-44ac-987e-67d5b715ca78 req-202407b0-8a70-4d58-9873-49a445c2529a tempest-VolumesAssistedSnapshotsTest-275775559 tempest-VolumesAssistedSnapshotsTest-275775559-project-member] Enqueued Resource ID: 2d0a478f-3de2-453c-980b-25efdb42c355 with Priority: HIGHEST for action security_group_members [ 864.809368] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d0a478f-3de2-453c-980b-25efdb42c355 with Priority: HIGHEST for action security_group_members [ 864.809368] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d0a478f-3de2-453c-980b-25efdb42c355 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.809368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.809368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.809368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.809368] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.809368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.809368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.810367] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.810594] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.810785] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d0a478f-3de2-453c-980b-25efdb42c355',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.023333] env[70006]: INFO networking_nsxv3.common.synchronization [None req-34de071e-c203-4503-a144-7e8d4f4d4901 None None] Enqueued Resource ID: 6f228ff8-9ee7-4f8a-87d6-cf75722968bc with Priority: HIGHEST for action port [ 865.023728] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f228ff8-9ee7-4f8a-87d6-cf75722968bc with Priority: HIGHEST for action port [ 865.024551] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f228ff8-9ee7-4f8a-87d6-cf75722968bc taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.024551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f228ff8-9ee7-4f8a-87d6-cf75722968bc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.024551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f228ff8-9ee7-4f8a-87d6-cf75722968bc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.024551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f228ff8-9ee7-4f8a-87d6-cf75722968bc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.024551] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f228ff8-9ee7-4f8a-87d6-cf75722968bc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.211621] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.211950] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.211950] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.212176] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.212176] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.212249] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 is going to be created. [ 865.239593] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.241319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.241440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.241693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.242105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.257286] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 in Status: UNINITIALIZED for 2s [ 865.313784] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.314054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.314169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.314346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.314434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.314623] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.314710] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.314771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.314912] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.314985] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.315080] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d0a478f-3de2-453c-980b-25efdb42c355 is going to be updated. [ 865.350135] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.350135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.350135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.350419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.350419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.361198] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d0a478f-3de2-453c-980b-25efdb42c355 in Status: IN_PROGRESS for 2s [ 865.527343] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f228ff8-9ee7-4f8a-87d6-cf75722968bc [ 865.527650] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.527849] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.527937] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.528170] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.528293] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.528729] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f228ff8-9ee7-4f8a-87d6-cf75722968bc already deleted. [ 865.528729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f228ff8-9ee7-4f8a-87d6-cf75722968bc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.581896] env[70006]: INFO networking_nsxv3.common.synchronization [req-3be523cf-1ca4-49e2-a04c-a7e9a4ac871a req-b0cd5251-2abd-4d16-8a63-49ee2d4c0d63 tempest-VolumesAdminNegativeTest-932475284 tempest-VolumesAdminNegativeTest-932475284-project-member] Enqueued Resource ID: 598ac99e-7479-4d78-948d-bd3f771adf65 with Priority: HIGHEST for action security_group_members [ 865.582919] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 598ac99e-7479-4d78-948d-bd3f771adf65 with Priority: HIGHEST for action security_group_members [ 865.583046] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-598ac99e-7479-4d78-948d-bd3f771adf65 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.583193] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.583260] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.585221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.585221] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.585221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.585221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.585221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.585221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.585221] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('598ac99e-7479-4d78-948d-bd3f771adf65',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.086632] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.086868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.086868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.087115] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.087989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.092028] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.092028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.092028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.092028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.092028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.092028] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 598ac99e-7479-4d78-948d-bd3f771adf65 is going to be updated. [ 866.139177] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.139397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.139397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.139781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.139781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.150463] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 598ac99e-7479-4d78-948d-bd3f771adf65 in Status: IN_PROGRESS for 2s [ 866.241290] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62110f9-4181-4c43-9e99-43fd5dff214d in Status: SUCCESS [ 866.241588] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62110f9-4181-4c43-9e99-43fd5dff214d deletion is rescheduled due to dependency. [ 866.241588] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.266186] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 in Status: SUCCESS [ 867.266473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.266701] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.266808] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.267007] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.267130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.267195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.267360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.267614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.267614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.267614] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd192c2d-795f-4fff-bacc-dc0eb6d345b8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.372891] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d0a478f-3de2-453c-980b-25efdb42c355 in Status: SUCCESS [ 867.373302] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d0a478f-3de2-453c-980b-25efdb42c355 deletion is rescheduled due to dependency. [ 867.373302] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.770312] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.770479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.770543] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.770982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.770982] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.771135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.771135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.771339] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.771404] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.771469] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.771640] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.771735] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.771806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.772459] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.772459] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.772459] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.772459] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.772459] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.772459] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.772771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.772771] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd192c2d-795f-4fff-bacc-dc0eb6d345b8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.162966] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 598ac99e-7479-4d78-948d-bd3f771adf65 in Status: SUCCESS [ 868.163205] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 598ac99e-7479-4d78-948d-bd3f771adf65 deletion is rescheduled due to dependency. [ 868.163323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.214658] env[70006]: INFO networking_nsxv3.common.synchronization [req-90390653-83ad-42f4-a007-d6889770846e req-d96e6cbc-65fc-4d0b-801f-8c8e7482f303 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 868.215365] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 868.215729] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.216220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.216220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.216220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.216432] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.216572] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.217426] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.218028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.218028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.218028] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.275054] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd192c2d-795f-4fff-bacc-dc0eb6d345b8: rpc.has_security_group_logging(os_id): False [ 868.295014] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.299164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.299164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.299164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.299358] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.299532] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.299615] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.299663] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.299870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.299963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.300180] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.300276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.300338] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.300503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.300539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.300796] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.300900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.300900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.301631] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.301631] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.301631] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 is going to be created. [ 868.360209] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.360302] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.360388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.360726] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.360885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.372733] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 in Status: IN_PROGRESS for 2s [ 868.720631] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.740471] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-671 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.740699] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-671" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.740935] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-671" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.741193] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-671" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.741475] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.741692] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.741863] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.742856] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.743038] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.743273] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.743389] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.743504] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.743652] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.743816] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.743935] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.744088] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.765642] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.766512] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 868.766675] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.766862] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-671" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.767232] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-95450791-e5ab-4650-be74-3d6299da9718 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.767414] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.767536] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.767874] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.768026] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95450791-e5ab-4650-be74-3d6299da9718',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.223433] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.270448] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.270659] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.270857] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.271146] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.271300] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.271460] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 95450791-e5ab-4650-be74-3d6299da9718 not found, creating... [ 869.271722] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.272092] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.272267] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.272492] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.272633] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.272912] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.273080] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.273203] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.273408] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.273541] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.273681] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 95450791-e5ab-4650-be74-3d6299da9718 is going to be created. [ 869.294492] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.294839] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.294839] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.295101] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.295335] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.295560] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.733040] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.733040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.733040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.733040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.733040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.733040] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 869.764323] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.764323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.764323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.766323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.766323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.774660] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 870.143172] env[70006]: INFO networking_nsxv3.common.synchronization [None req-e54415c3-eb18-47ae-a929-62d2aed94ff4 None None] Enqueued Resource ID: f436e9fa-9b89-4ee4-8b3b-561bf1df5696 with Priority: HIGHEST for action port [ 870.146500] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f436e9fa-9b89-4ee4-8b3b-561bf1df5696 with Priority: HIGHEST for action port [ 870.146500] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-f436e9fa-9b89-4ee4-8b3b-561bf1df5696 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.146500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f436e9fa-9b89-4ee4-8b3b-561bf1df5696" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.146500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f436e9fa-9b89-4ee4-8b3b-561bf1df5696" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.146500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f436e9fa-9b89-4ee4-8b3b-561bf1df5696" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.146500] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f436e9fa-9b89-4ee4-8b3b-561bf1df5696',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.392113] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 in Status: SUCCESS [ 870.392606] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.428924] env[70006]: INFO networking_nsxv3.common.synchronization [req-90390653-83ad-42f4-a007-d6889770846e req-b93bf16b-9e80-49e7-ad2c-3b93e1cfa918 service nova] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_rules [ 870.429025] env[70006]: INFO networking_nsxv3.common.synchronization [req-90390653-83ad-42f4-a007-d6889770846e req-b93bf16b-9e80-49e7-ad2c-3b93e1cfa918 service nova] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 870.429151] env[70006]: INFO networking_nsxv3.common.synchronization [req-90390653-83ad-42f4-a007-d6889770846e req-b93bf16b-9e80-49e7-ad2c-3b93e1cfa918 service nova] Enqueued Resource ID: 95450791-e5ab-4650-be74-3d6299da9718 with Priority: HIGHEST for action port [ 870.429564] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_rules [ 870.429615] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 870.429835] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95450791-e5ab-4650-be74-3d6299da9718 with Priority: HIGHEST for action port [ 870.430521] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.430651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.430719] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.430921] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.431012] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.435303] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.435303] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.435303] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-95450791-e5ab-4650-be74-3d6299da9718 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.435303] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.435303] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.435303] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.435303] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95450791-e5ab-4650-be74-3d6299da9718',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.651391] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f436e9fa-9b89-4ee4-8b3b-561bf1df5696 [ 870.651686] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.653018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.653018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.653018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.653018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.653018] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f436e9fa-9b89-4ee4-8b3b-561bf1df5696 already deleted. [ 870.653018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f436e9fa-9b89-4ee4-8b3b-561bf1df5696" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.714609] env[70006]: INFO networking_nsxv3.common.synchronization [req-e950401c-b3f3-44d6-aa28-9957a82fec86 req-b9aec436-435d-41ad-926a-bc0607527963 tempest-ServerRescueNegativeTestJSON-1434609939 tempest-ServerRescueNegativeTestJSON-1434609939-project-member] Enqueued Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_members [ 870.715431] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_members [ 870.716087] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.716087] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.716427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.716812] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.717205] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.718035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.718035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.720676] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.720676] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.720676] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.938436] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.938436] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.938436] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95450791-e5ab-4650-be74-3d6299da9718 with status ACTIVE [ 870.938652] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.940038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.940038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.940038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.940038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.940038] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.940038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.940038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.940038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.940038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.940038] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.940038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.940038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.941395] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.941395] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.941395] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95450791-e5ab-4650-be74-3d6299da9718 is going to be updated. [ 870.966830] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.967039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.967082] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.967276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.967419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.967869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.185098] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.185291] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-833" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.185422] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-833" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.185762] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-833" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.186035] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.186195] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.186314] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.186537] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.188113] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.188457] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 871.188597] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.188698] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.189413] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.189564] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 871.189679] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.189844] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.210276] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.210276] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 871.210276] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.210276] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-833" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.210276] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-4a9242b0-4afa-443e-9ccd-dc35313fc59a taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.210276] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-4a9242b0-4afa-443e-9ccd-dc35313fc59a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.210276] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-4a9242b0-4afa-443e-9ccd-dc35313fc59a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.210616] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-4a9242b0-4afa-443e-9ccd-dc35313fc59a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.210767] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a9242b0-4afa-443e-9ccd-dc35313fc59a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.225430] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.225430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.225430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.225694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.225760] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.226085] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.226198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.226198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.226996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.226996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.226996] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 already deleted. [ 871.226996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.659421] env[70006]: INFO networking_nsxv3.common.synchronization [req-7d3bd08b-ae51-49dc-b344-035d69a10fd0 req-8be33fc6-6d50-4dba-a865-7b70631b43f1 tempest-MigrationsAdminTest-838255870 tempest-MigrationsAdminTest-838255870-project-member] Enqueued Resource ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 with Priority: HIGHEST for action security_group_members [ 871.659421] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 with Priority: HIGHEST for action security_group_members [ 871.659421] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f885e47a-f0d6-416e-9871-7d36cac6dbc6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.659421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.659421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.660650] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.661061] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.661372] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.661980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.662464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.662695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.663026] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f885e47a-f0d6-416e-9871-7d36cac6dbc6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.716166] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.716166] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.716166] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.716166] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.716166] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.716166] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 4a9242b0-4afa-443e-9ccd-dc35313fc59a not found, creating... [ 871.716166] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.716166] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.716166] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.716166] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.716166] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.716608] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.716608] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.717059] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.717416] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.717676] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.717932] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 4a9242b0-4afa-443e-9ccd-dc35313fc59a is going to be created. [ 871.733323] env[70006]: INFO networking_nsxv3.common.synchronization [None req-7eaa9e88-3beb-4e5a-952c-a816e36e1e3c tempest-AttachVolumeShelveTestJSON-1969238173 tempest-AttachVolumeShelveTestJSON-1969238173-project-member] Enqueued Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_rules [ 871.733323] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_rules [ 871.733323] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.735400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.737399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.738828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.739570] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.741444] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.741610] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.741870] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.742017] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.744371] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.744371] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-4a9242b0-4afa-443e-9ccd-dc35313fc59a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.785853] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 871.786267] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.786372] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.786552] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.786805] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.786889] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.786962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.787154] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.787233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.787359] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.883146] env[70006]: INFO networking_nsxv3.common.synchronization [None req-dda6b8a6-6fff-4db8-808d-15f74f3542ac tempest-AttachVolumeShelveTestJSON-1969238173 tempest-AttachVolumeShelveTestJSON-1969238173-project-member] Enqueued Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_rules [ 871.883696] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_rules [ 871.884016] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.884118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.168926] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.168926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.168926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.168926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.168926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.168926] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.168926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.168926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.168926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.168926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.168926] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 is going to be updated. [ 872.199875] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.201032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.201032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.201032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.203020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.212581] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 in Status: IN_PROGRESS for 2s [ 872.270297] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.270297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.270297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.270297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.270297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.270297] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c already deleted. [ 872.270297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.270297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.270297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.270297] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.291398] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.636210] env[70006]: INFO networking_nsxv3.common.synchronization [req-e950401c-b3f3-44d6-aa28-9957a82fec86 req-f49cd0e9-642c-4aae-bbdf-61b69ca55b5a service nova] Enqueued Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_rules [ 872.636210] env[70006]: INFO networking_nsxv3.common.synchronization [req-e950401c-b3f3-44d6-aa28-9957a82fec86 req-f49cd0e9-642c-4aae-bbdf-61b69ca55b5a service nova] Enqueued Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_members [ 872.636210] env[70006]: INFO networking_nsxv3.common.synchronization [req-e950401c-b3f3-44d6-aa28-9957a82fec86 req-f49cd0e9-642c-4aae-bbdf-61b69ca55b5a service nova] Enqueued Resource ID: 4a9242b0-4afa-443e-9ccd-dc35313fc59a with Priority: HIGHEST for action port [ 872.636210] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_rules [ 872.636210] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_members [ 872.636210] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a9242b0-4afa-443e-9ccd-dc35313fc59a with Priority: HIGHEST for action port [ 872.637596] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.638720] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.638833] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.639133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.640146] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.645864] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.647388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.647475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.647712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.648868] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.648868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.648868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.648868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.648868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.648868] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.649397] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a9242b0-4afa-443e-9ccd-dc35313fc59a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.649501] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a9242b0-4afa-443e-9ccd-dc35313fc59a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.649565] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a9242b0-4afa-443e-9ccd-dc35313fc59a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.649722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a9242b0-4afa-443e-9ccd-dc35313fc59a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.649833] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a9242b0-4afa-443e-9ccd-dc35313fc59a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.789600] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.789865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.789865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.790176] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.790176] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.790270] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c already deleted. [ 872.790326] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.793699] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.826541] env[70006]: INFO networking_nsxv3.common.synchronization [None req-16e332d8-6f20-4f1f-8af3-3a76dd2cf986 None None] Enqueued Resource ID: 519a1236-4913-4b72-a16b-efafff87f5fb with Priority: HIGHEST for action port [ 872.827216] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 519a1236-4913-4b72-a16b-efafff87f5fb with Priority: HIGHEST for action port [ 872.827428] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-519a1236-4913-4b72-a16b-efafff87f5fb taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.827548] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-519a1236-4913-4b72-a16b-efafff87f5fb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.827616] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-519a1236-4913-4b72-a16b-efafff87f5fb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.827861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-519a1236-4913-4b72-a16b-efafff87f5fb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.827947] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('519a1236-4913-4b72-a16b-efafff87f5fb',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.136980] env[70006]: INFO networking_nsxv3.common.synchronization [req-36443c68-0a2e-41b4-9ab5-ada1ebc4591b req-13721dc3-ebf6-447c-ae24-18c0d98b8fcb tempest-InstanceActionsTestJSON-1929193662 tempest-InstanceActionsTestJSON-1929193662-project-member] Enqueued Resource ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c with Priority: HIGHEST for action security_group_members [ 873.137524] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c with Priority: HIGHEST for action security_group_members [ 873.137825] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.137946] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.138272] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.138502] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.138686] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.139195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.139195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.139195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.139195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.139195] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.155268] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.155268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.155268] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.156392] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a9242b0-4afa-443e-9ccd-dc35313fc59a with status ACTIVE [ 873.156392] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.156539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.156620] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.157202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.157292] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.157521] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.157648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.157720] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.157927] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.158034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.159849] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.159849] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.159849] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.159849] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.159849] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.159849] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a9242b0-4afa-443e-9ccd-dc35313fc59a is going to be updated. [ 873.189818] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.189905] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.189937] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.192802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.192802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.192802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a9242b0-4afa-443e-9ccd-dc35313fc59a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.296266] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.296438] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.296501] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.298055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.298174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.298260] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 873.331251] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 519a1236-4913-4b72-a16b-efafff87f5fb [ 873.335376] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.335567] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.335639] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.335870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.335949] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.336053] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:519a1236-4913-4b72-a16b-efafff87f5fb already deleted. [ 873.336131] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-519a1236-4913-4b72-a16b-efafff87f5fb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.337209] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.337322] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.337387] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.337549] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.337762] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.349041] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 873.641166] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.641365] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.641409] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.641644] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.645025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.645025] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.645025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.645025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.645025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.645025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.645025] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c is going to be updated. [ 873.661037] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.674582] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.674582] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.674582] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.674582] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.674582] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.685825] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c in Status: IN_PROGRESS for 2s [ 874.170159] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.170159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.170159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.170159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.170159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.170159] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 is going to be created. [ 874.211068] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.211361] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.211361] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.211586] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.211718] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.238902] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 in Status: SUCCESS [ 874.239549] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 deletion is rescheduled due to dependency. [ 874.239549] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.240058] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: UNINITIALIZED for 2s [ 874.423605] env[70006]: INFO networking_nsxv3.common.synchronization [None req-12e146f3-ef34-4418-946a-a0f5c2e04c9c None None] Enqueued Resource ID: 0016b439-e622-4f65-9289-3a57bcd0847a with Priority: HIGHEST for action port [ 874.423712] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0016b439-e622-4f65-9289-3a57bcd0847a with Priority: HIGHEST for action port [ 874.424251] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-0016b439-e622-4f65-9289-3a57bcd0847a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.424377] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0016b439-e622-4f65-9289-3a57bcd0847a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.424485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0016b439-e622-4f65-9289-3a57bcd0847a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.424686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0016b439-e622-4f65-9289-3a57bcd0847a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.424774] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0016b439-e622-4f65-9289-3a57bcd0847a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.927087] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0016b439-e622-4f65-9289-3a57bcd0847a [ 874.927378] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.928501] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.928501] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.928501] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.928501] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.928501] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0016b439-e622-4f65-9289-3a57bcd0847a already deleted. [ 874.928501] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0016b439-e622-4f65-9289-3a57bcd0847a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.363284] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 875.363567] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.363737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.364099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.364284] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.364284] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.364423] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.364508] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.364592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.364679] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.364776] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.696377] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c in Status: SUCCESS [ 875.696377] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c deletion is rescheduled due to dependency. [ 875.696377] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.868708] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.868708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.868708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.868708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.869193] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.875174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.875174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.875174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.875174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.875174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.875174] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.875174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.875174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.875174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.875174] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.875174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.875174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.875174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.875174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.875174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.875174] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.254825] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: SUCCESS [ 876.260159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.260159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.260159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.260159] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.260159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.260159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.260159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.260159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.260159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.260159] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.378165] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6: rpc.has_security_group_logging(os_id): False [ 876.401055] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.401055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.401055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.401055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.401055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.401055] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.401055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.401055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.401055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.401055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.401055] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.401055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.401055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.401055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.401055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.401685] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.401685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.401685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.401685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.401685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.406272] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 876.497047] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.497621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.497819] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.498189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.498448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.516029] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 876.766945] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.766945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.766945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.766945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.766945] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.766945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.766945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.766945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.766945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.766945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.766945] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.766945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.766945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.766945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.766945] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.766945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.767706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.767706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.767706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.767706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.767706] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.030292] env[70006]: INFO networking_nsxv3.common.synchronization [None req-d84ac55d-f0e2-4968-9ec5-a51f799c9390 None None] Enqueued Resource ID: a3b31163-cb8c-48a6-a247-84ea367b4d9d with Priority: HIGHEST for action port [ 877.033652] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3b31163-cb8c-48a6-a247-84ea367b4d9d with Priority: HIGHEST for action port [ 877.035288] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3b31163-cb8c-48a6-a247-84ea367b4d9d taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.035711] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3b31163-cb8c-48a6-a247-84ea367b4d9d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.035898] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3b31163-cb8c-48a6-a247-84ea367b4d9d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.036294] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3b31163-cb8c-48a6-a247-84ea367b4d9d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.036401] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3b31163-cb8c-48a6-a247-84ea367b4d9d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.089229] env[70006]: INFO networking_nsxv3.common.synchronization [None req-f769ad77-b8f7-4cae-a391-a13c916ebd1a None None] Enqueued Resource ID: bba187ee-f80d-46ee-bef8-1ecf687589d2 with Priority: HIGHEST for action port [ 877.089229] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bba187ee-f80d-46ee-bef8-1ecf687589d2 with Priority: HIGHEST for action port [ 877.089229] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-bba187ee-f80d-46ee-bef8-1ecf687589d2 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.089229] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bba187ee-f80d-46ee-bef8-1ecf687589d2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.089229] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bba187ee-f80d-46ee-bef8-1ecf687589d2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.089229] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bba187ee-f80d-46ee-bef8-1ecf687589d2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.089229] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bba187ee-f80d-46ee-bef8-1ecf687589d2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.272192] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4aa62458-e6a1-47ca-9f29-72a54d1dc002: rpc.has_security_group_logging(os_id): False [ 877.299091] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.299091] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.299305] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.299453] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.299453] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.299672] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.299823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.299890] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.300033] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.300107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.300385] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.300385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.300570] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.300570] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.300687] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.300824] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.300968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.300968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.301510] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.301612] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.301737] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 is going to be created. [ 877.358096] env[70006]: INFO networking_nsxv3.common.synchronization [req-70ba3fb0-9a8a-499e-9d3c-15ac27b9cc96 req-dc035306-967c-4ef7-95f6-96d498bf9dc6 tempest-ServersAdminTestJSON-372282544 tempest-ServersAdminTestJSON-372282544-project-member] Enqueued Resource ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 with Priority: HIGHEST for action security_group_members [ 877.358652] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 with Priority: HIGHEST for action security_group_members [ 877.358999] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.359240] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.359240] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.359411] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.359864] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.359864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.359864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.360026] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.360026] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.360246] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd192c2d-795f-4fff-bacc-dc0eb6d345b8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.390545] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.390902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.390902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.391145] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.391405] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.424998] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: IN_PROGRESS for 2s [ 877.541838] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3b31163-cb8c-48a6-a247-84ea367b4d9d [ 877.542132] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.542334] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.542334] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.542524] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.542622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.542714] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3b31163-cb8c-48a6-a247-84ea367b4d9d already deleted. [ 877.542799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3b31163-cb8c-48a6-a247-84ea367b4d9d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.592357] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bba187ee-f80d-46ee-bef8-1ecf687589d2 [ 877.592631] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.592776] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.592857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.593141] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.593246] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.593368] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bba187ee-f80d-46ee-bef8-1ecf687589d2 already deleted. [ 877.593457] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bba187ee-f80d-46ee-bef8-1ecf687589d2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.863121] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.863385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.863453] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.863925] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.863925] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.865830] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.865830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.865830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.865830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.866180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.866180] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 is going to be updated. [ 877.905410] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.905410] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.905410] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.905410] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.905410] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.917853] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 in Status: IN_PROGRESS for 2s [ 877.921734] env[70006]: INFO networking_nsxv3.common.synchronization [req-ba5bae4c-316a-47a9-9b55-7aac7eb3f0ba req-345f5dcb-6cf4-4cff-89f6-5c0375cab11e tempest-ServerRescueNegativeTestJSON-1434609939 tempest-ServerRescueNegativeTestJSON-1434609939-project-member] Enqueued Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_members [ 877.922358] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_members [ 877.922692] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.923538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.923538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.923538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.923538] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.923731] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.923731] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.923857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.923992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.924106] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.426634] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.438866] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.438866] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-833" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.438866] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-833" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.438866] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-833" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.438866] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.438866] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.438866] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.438866] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.438866] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.438866] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.439327] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.439327] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.439327] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.439327] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.439448] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.439514] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.467210] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.467402] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 878.467543] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.467788] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-833" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.468046] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-25ae3868-dd45-4f4c-8b91-809dcb235f5c taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.468239] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-25ae3868-dd45-4f4c-8b91-809dcb235f5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.468341] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-25ae3868-dd45-4f4c-8b91-809dcb235f5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.468652] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-25ae3868-dd45-4f4c-8b91-809dcb235f5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.468829] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25ae3868-dd45-4f4c-8b91-809dcb235f5c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.533371] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 878.533371] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.928637] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.976232] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.976551] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.976634] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.977070] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.977155] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.977287] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 25ae3868-dd45-4f4c-8b91-809dcb235f5c not found, creating... [ 878.977640] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.977840] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.977941] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.978189] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.978332] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.978624] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.978781] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.978900] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.979151] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.979299] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.983192] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 25ae3868-dd45-4f4c-8b91-809dcb235f5c is going to be created. [ 879.007447] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.007652] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.007785] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.012904] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.013260] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.013541] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-25ae3868-dd45-4f4c-8b91-809dcb235f5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.014766] env[70006]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] NSXv3 Agent Agent loop - iteration:0 completed [ 879.014889] env[70006]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] NSXv3 Agent Agent loop - iteration:1 started [ 879.434634] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.434982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.434982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.435334] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.435515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.435687] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 is going to be updated. [ 879.439640] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: SUCCESS [ 879.439969] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.466184] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.466411] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.466490] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.466680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.466854] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.476865] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: IN_PROGRESS for 2s [ 879.635257] env[70006]: INFO networking_nsxv3.common.synchronization [None req-b74d4c4e-1d33-476c-9a5e-3bf54f108820 None None] Enqueued Resource ID: 86edc005-a423-4d00-9000-520410023f41 with Priority: HIGHEST for action port [ 879.635257] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86edc005-a423-4d00-9000-520410023f41 with Priority: HIGHEST for action port [ 879.635812] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-86edc005-a423-4d00-9000-520410023f41 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.635942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86edc005-a423-4d00-9000-520410023f41" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.636024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86edc005-a423-4d00-9000-520410023f41" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.636294] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86edc005-a423-4d00-9000-520410023f41" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.636387] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86edc005-a423-4d00-9000-520410023f41',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.726718] env[70006]: INFO networking_nsxv3.common.synchronization [req-ba5bae4c-316a-47a9-9b55-7aac7eb3f0ba req-fcd220f0-9f28-4a55-9291-3981a4874022 service nova] Enqueued Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_rules [ 879.726718] env[70006]: INFO networking_nsxv3.common.synchronization [req-ba5bae4c-316a-47a9-9b55-7aac7eb3f0ba req-fcd220f0-9f28-4a55-9291-3981a4874022 service nova] Enqueued Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_members [ 879.726718] env[70006]: INFO networking_nsxv3.common.synchronization [req-ba5bae4c-316a-47a9-9b55-7aac7eb3f0ba req-fcd220f0-9f28-4a55-9291-3981a4874022 service nova] Enqueued Resource ID: 25ae3868-dd45-4f4c-8b91-809dcb235f5c with Priority: HIGHEST for action port [ 879.727530] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_rules [ 879.727530] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_members [ 879.727530] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ae3868-dd45-4f4c-8b91-809dcb235f5c with Priority: HIGHEST for action port [ 879.727864] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.728030] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.728096] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.728306] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.728391] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.730164] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.730164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.730262] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-25ae3868-dd45-4f4c-8b91-809dcb235f5c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.730326] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25ae3868-dd45-4f4c-8b91-809dcb235f5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.730361] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25ae3868-dd45-4f4c-8b91-809dcb235f5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.730540] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25ae3868-dd45-4f4c-8b91-809dcb235f5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.730615] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25ae3868-dd45-4f4c-8b91-809dcb235f5c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.928444] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 in Status: SUCCESS [ 879.928638] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 deletion is rescheduled due to dependency. [ 879.929619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.967994] env[70006]: INFO networking_nsxv3.common.synchronization [req-5f7aa62c-9524-4b9b-af8c-ec06fc7664e3 req-4eda8e57-163b-4fef-b39e-4108b2d64444 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: bb9049e5-2996-4128-866a-9998244adb75 with Priority: HIGHEST for action security_group_members [ 879.968180] env[70006]: INFO networking_nsxv3.common.synchronization [req-5f7aa62c-9524-4b9b-af8c-ec06fc7664e3 req-4eda8e57-163b-4fef-b39e-4108b2d64444 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 879.968695] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9049e5-2996-4128-866a-9998244adb75 with Priority: HIGHEST for action security_group_members [ 879.968847] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 879.969509] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb9049e5-2996-4128-866a-9998244adb75 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.969642] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.970324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.970324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.970452] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.970562] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.970617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.970770] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.970954] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.971054] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb9049e5-2996-4128-866a-9998244adb75',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.972339] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.973209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.973209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.973209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.973209] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.973209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.973452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.973452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.973554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.973656] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.019268] env[70006]: INFO networking_nsxv3.common.synchronization [req-5f7aa62c-9524-4b9b-af8c-ec06fc7664e3 req-4eda8e57-163b-4fef-b39e-4108b2d64444 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_rules [ 880.019268] env[70006]: INFO networking_nsxv3.common.synchronization [req-5f7aa62c-9524-4b9b-af8c-ec06fc7664e3 req-4eda8e57-163b-4fef-b39e-4108b2d64444 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 880.019268] env[70006]: INFO networking_nsxv3.common.synchronization [req-5f7aa62c-9524-4b9b-af8c-ec06fc7664e3 req-4eda8e57-163b-4fef-b39e-4108b2d64444 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: bb9049e5-2996-4128-866a-9998244adb75 with Priority: HIGHEST for action security_group_rules [ 880.019268] env[70006]: INFO networking_nsxv3.common.synchronization [req-5f7aa62c-9524-4b9b-af8c-ec06fc7664e3 req-4eda8e57-163b-4fef-b39e-4108b2d64444 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: bb9049e5-2996-4128-866a-9998244adb75 with Priority: HIGHEST for action security_group_members [ 880.019473] env[70006]: INFO networking_nsxv3.common.synchronization [req-5f7aa62c-9524-4b9b-af8c-ec06fc7664e3 req-4eda8e57-163b-4fef-b39e-4108b2d64444 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 95450791-e5ab-4650-be74-3d6299da9718 with Priority: HIGHEST for action port [ 880.019962] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_rules [ 880.020106] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9049e5-2996-4128-866a-9998244adb75 with Priority: HIGHEST for action security_group_rules [ 880.020245] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95450791-e5ab-4650-be74-3d6299da9718 with Priority: HIGHEST for action port [ 880.020509] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 880.020509] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9049e5-2996-4128-866a-9998244adb75 with Priority: HIGHEST for action security_group_members [ 880.021264] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.021264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.021264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.021426] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.021426] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.023448] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb9049e5-2996-4128-866a-9998244adb75 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.023448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.023448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.023448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.023448] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb9049e5-2996-4128-866a-9998244adb75',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.023783] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-95450791-e5ab-4650-be74-3d6299da9718 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.024496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.024574] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.024800] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.024897] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95450791-e5ab-4650-be74-3d6299da9718',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.026031] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.026112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.026295] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb9049e5-2996-4128-866a-9998244adb75 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.026371] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.139688] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86edc005-a423-4d00-9000-520410023f41 [ 880.139892] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.140054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.140128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.140434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.140538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.140639] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86edc005-a423-4d00-9000-520410023f41 already deleted. [ 880.140725] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86edc005-a423-4d00-9000-520410023f41" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.230561] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.230711] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.233593] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25ae3868-dd45-4f4c-8b91-809dcb235f5c with status ACTIVE [ 880.233765] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.233905] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.233975] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.234231] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.234323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.234853] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.234853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.234853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.234853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.235257] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.235257] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.235257] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.235257] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.235418] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.235503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.235548] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25ae3868-dd45-4f4c-8b91-809dcb235f5c is going to be updated. [ 880.275010] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.275187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.275254] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.275456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.275810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.275987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25ae3868-dd45-4f4c-8b91-809dcb235f5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.473052] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb9049e5-2996-4128-866a-9998244adb75',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.476296] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.526622] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95450791-e5ab-4650-be74-3d6299da9718 with status ACTIVE [ 880.527392] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.527392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.527392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.527392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.527717] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.527717] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.527795] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.527839] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.527998] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.528091] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.528285] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.528383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.528460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.528669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.528757] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.528846] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95450791-e5ab-4650-be74-3d6299da9718 is going to be updated. [ 880.530165] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.530261] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.530490] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb9049e5-2996-4128-866a-9998244adb75 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.530586] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.552896] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.552896] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.552896] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.553138] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.553339] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.553555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.975751] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb9049e5-2996-4128-866a-9998244adb75',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.979579] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.479794] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.480240] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.480361] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.480592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.480697] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.480801] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb9049e5-2996-4128-866a-9998244adb75 is going to be created. [ 881.483384] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.487026] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.487026] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.487026] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.487026] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.487026] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 881.496013] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: SUCCESS [ 881.496501] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.496680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.496924] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.497142] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.497490] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.497611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.497885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.497979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.498224] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.516179] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.520025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.520025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.520025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.520025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.521062] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.521178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.521178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.521371] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.521514] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.532054] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 881.533402] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9049e5-2996-4128-866a-9998244adb75 in Status: UNINITIALIZED for 2s [ 882.000431] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.506705] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.010560] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.010681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.010681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.010926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.011038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.011139] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 is going to be updated. [ 883.034837] env[70006]: INFO networking_nsxv3.common.synchronization [None req-18ace104-1c54-451d-be8a-6fb8178d6f20 tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 with Priority: HIGHEST for action security_group_rules [ 883.035909] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 with Priority: HIGHEST for action security_group_rules [ 883.036240] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.036366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.036432] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.036680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.036768] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3c6c493-02b2-4cc9-86d0-15e7a48daae4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.041529] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.041692] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.041781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.044337] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.044502] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.054749] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: IN_PROGRESS for 2s [ 883.185570] env[70006]: INFO networking_nsxv3.common.synchronization [None req-a15fa6e0-5be8-47a3-9f79-562d7027d35c tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 with Priority: HIGHEST for action security_group_rules [ 883.185570] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 with Priority: HIGHEST for action security_group_rules [ 883.185570] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.185722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.682981] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 883.682981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.682981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.682981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.682981] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.682981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.682981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.682981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.682981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.682981] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.684552] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9049e5-2996-4128-866a-9998244adb75 in Status: SUCCESS [ 883.684748] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.684898] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.685091] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.685301] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.685393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.685466] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.685553] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.685633] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.685726] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb9049e5-2996-4128-866a-9998244adb75',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.698047] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.698047] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.698047] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.698277] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.698277] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.698375] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 already deleted. [ 883.698458] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.698950] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.699076] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.699162] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3c6c493-02b2-4cc9-86d0-15e7a48daae4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.192415] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb9049e5-2996-4128-866a-9998244adb75',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.193410] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.219314] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.219525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.219525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.219683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.219774] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.219899] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 already deleted. [ 884.219998] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.696029] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.697267] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb9049e5-2996-4128-866a-9998244adb75',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.738725] env[70006]: INFO networking_nsxv3.common.synchronization [req-748ffec7-cc23-4672-abba-564fc5ea686c req-845bea09-372d-4691-bdc0-582385e48998 tempest-ServersV294TestFqdnHostnames-1142748138 tempest-ServersV294TestFqdnHostnames-1142748138-project-member] Enqueued Resource ID: e45746ed-781c-4f14-807a-e9e8876db03b with Priority: HIGHEST for action security_group_members [ 884.739349] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45746ed-781c-4f14-807a-e9e8876db03b with Priority: HIGHEST for action security_group_members [ 884.739653] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45746ed-781c-4f14-807a-e9e8876db03b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.739814] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.739860] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.740242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.740348] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.740472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.740562] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.740750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.740899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.741014] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45746ed-781c-4f14-807a-e9e8876db03b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.067455] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: SUCCESS [ 885.067455] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.067455] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.067455] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.067455] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.067455] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.067455] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.067455] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.067455] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.067455] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.067455] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.076030] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.076030] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-252" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.076030] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-252" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.076030] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-252" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.076030] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.076030] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.076030] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.076030] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.077353] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.077816] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.078170] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.078458] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.078675] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.078888] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.079104] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.079516] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.102019] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.102019] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 885.102019] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.102019] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-252" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.102019] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-04205eac-90e1-47c0-82c4-703b9258de68 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.102019] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-04205eac-90e1-47c0-82c4-703b9258de68" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.102019] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-04205eac-90e1-47c0-82c4-703b9258de68" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.102019] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-04205eac-90e1-47c0-82c4-703b9258de68" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.102019] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04205eac-90e1-47c0-82c4-703b9258de68',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.202126] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.202126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.202126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.202126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.202126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.202126] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 885.202126] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.202126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.202126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.202126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.202768] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.202942] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb9049e5-2996-4128-866a-9998244adb75 is going to be updated. [ 885.245186] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.245186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.245186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.245338] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.245420] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.245597] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.245702] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.245768] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.245930] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.245998] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.246092] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45746ed-781c-4f14-807a-e9e8876db03b already deleted. [ 885.246172] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.270716] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.270920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.270984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.271187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.271347] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.283055] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.283287] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.283362] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.283575] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.283721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.291285] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 885.293964] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9049e5-2996-4128-866a-9998244adb75 in Status: IN_PROGRESS for 2s [ 885.573538] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.573753] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.573797] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.574035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.574213] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.574314] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.574375] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.574527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.574617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.574704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.574849] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.574942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.575012] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.575158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.575294] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.575383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.575440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.575575] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.575650] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.575731] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.575830] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.604976] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.605278] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.605410] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.605684] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.605834] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.605989] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 04205eac-90e1-47c0-82c4-703b9258de68 not found, creating... [ 885.606310] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.606475] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.606593] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.606888] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.606990] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.607336] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.607521] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.607644] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.608266] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.608266] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.608266] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 04205eac-90e1-47c0-82c4-703b9258de68 is going to be created. [ 885.629425] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.629672] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.629726] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.630099] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.630396] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.630562] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-04205eac-90e1-47c0-82c4-703b9258de68" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.090413] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4aa62458-e6a1-47ca-9f29-72a54d1dc002: rpc.has_security_group_logging(os_id): False [ 886.096399] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.096876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.096876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.096972] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.097027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.097284] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.097363] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.097443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.097598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.097679] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.097934] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.098080] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.098144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.098311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.098393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.098714] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.098714] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.098822] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.098930] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.099038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.099134] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 is going to be updated. [ 886.171641] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.171641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.171641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.171641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.171641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.207111] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: IN_PROGRESS for 2s [ 886.372851] env[70006]: INFO networking_nsxv3.common.synchronization [req-748ffec7-cc23-4672-abba-564fc5ea686c req-3d1aa265-91f5-44e8-a603-838825047d29 service nova] Enqueued Resource ID: e45746ed-781c-4f14-807a-e9e8876db03b with Priority: HIGHEST for action security_group_rules [ 886.373252] env[70006]: INFO networking_nsxv3.common.synchronization [req-748ffec7-cc23-4672-abba-564fc5ea686c req-3d1aa265-91f5-44e8-a603-838825047d29 service nova] Enqueued Resource ID: e45746ed-781c-4f14-807a-e9e8876db03b with Priority: HIGHEST for action security_group_members [ 886.374025] env[70006]: INFO networking_nsxv3.common.synchronization [req-748ffec7-cc23-4672-abba-564fc5ea686c req-3d1aa265-91f5-44e8-a603-838825047d29 service nova] Enqueued Resource ID: 04205eac-90e1-47c0-82c4-703b9258de68 with Priority: HIGHEST for action port [ 886.374305] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45746ed-781c-4f14-807a-e9e8876db03b with Priority: HIGHEST for action security_group_rules [ 886.374555] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45746ed-781c-4f14-807a-e9e8876db03b with Priority: HIGHEST for action security_group_members [ 886.374754] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04205eac-90e1-47c0-82c4-703b9258de68 with Priority: HIGHEST for action port [ 886.375127] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e45746ed-781c-4f14-807a-e9e8876db03b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.377730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.377730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.377730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.377730] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e45746ed-781c-4f14-807a-e9e8876db03b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.377730] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45746ed-781c-4f14-807a-e9e8876db03b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.377730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.377730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.377730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.377730] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.377730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.377730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.377730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.377730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.377730] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45746ed-781c-4f14-807a-e9e8876db03b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.383365] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-04205eac-90e1-47c0-82c4-703b9258de68 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.383523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04205eac-90e1-47c0-82c4-703b9258de68" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.384830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04205eac-90e1-47c0-82c4-703b9258de68" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.384830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04205eac-90e1-47c0-82c4-703b9258de68" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.385988] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04205eac-90e1-47c0-82c4-703b9258de68',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.627063] env[70006]: INFO networking_nsxv3.common.synchronization [None req-d1b38e1f-7fbc-4bc9-aea2-81cf8559fbb6 None None] Enqueued Resource ID: c791268e-f7a5-438c-aaa7-f5cc925643c6 with Priority: HIGHEST for action port [ 886.627063] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c791268e-f7a5-438c-aaa7-f5cc925643c6 with Priority: HIGHEST for action port [ 886.627063] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-c791268e-f7a5-438c-aaa7-f5cc925643c6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.627063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c791268e-f7a5-438c-aaa7-f5cc925643c6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.627063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c791268e-f7a5-438c-aaa7-f5cc925643c6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.627923] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c791268e-f7a5-438c-aaa7-f5cc925643c6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.628180] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c791268e-f7a5-438c-aaa7-f5cc925643c6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.845775] env[70006]: INFO networking_nsxv3.common.synchronization [req-f3858725-a96b-41c5-a665-0d9f8cb5c97a req-a9be1b65-be2c-47f3-b6e5-9feac925e5d8 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: bb9049e5-2996-4128-866a-9998244adb75 with Priority: HIGHEST for action security_group_members [ 886.845872] env[70006]: INFO networking_nsxv3.common.synchronization [req-f3858725-a96b-41c5-a665-0d9f8cb5c97a req-a9be1b65-be2c-47f3-b6e5-9feac925e5d8 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 886.846019] env[70006]: INFO networking_nsxv3.common.synchronization [req-f3858725-a96b-41c5-a665-0d9f8cb5c97a req-a9be1b65-be2c-47f3-b6e5-9feac925e5d8 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c with Priority: HIGHEST for action security_group_members [ 886.846542] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9049e5-2996-4128-866a-9998244adb75 with Priority: HIGHEST for action security_group_members [ 886.846675] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 886.846771] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c with Priority: HIGHEST for action security_group_members [ 886.847588] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb9049e5-2996-4128-866a-9998244adb75 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.847756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.848056] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.848209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.848581] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b0b1745-132f-45fa-b34f-f394a3502d5c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.849349] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.849513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.849819] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.850059] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.850230] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.850337] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.850925] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.851089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.851243] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b0b1745-132f-45fa-b34f-f394a3502d5c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.888650] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e45746ed-781c-4f14-807a-e9e8876db03b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.889611] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45746ed-781c-4f14-807a-e9e8876db03b taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.889755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.889932] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04205eac-90e1-47c0-82c4-703b9258de68 with status ACTIVE [ 886.890113] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.890224] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.890290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.890489] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.890586] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.890755] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.890853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.890933] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.891119] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.891216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.891452] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.891507] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.891539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.891704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.891809] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.891845] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04205eac-90e1-47c0-82c4-703b9258de68 is going to be updated. [ 886.935974] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.936067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.936107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.936309] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.936476] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.936652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04205eac-90e1-47c0-82c4-703b9258de68" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.960260] env[70006]: INFO networking_nsxv3.common.synchronization [req-f3858725-a96b-41c5-a665-0d9f8cb5c97a req-a9be1b65-be2c-47f3-b6e5-9feac925e5d8 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c with Priority: HIGHEST for action security_group_rules [ 886.960391] env[70006]: INFO networking_nsxv3.common.synchronization [req-f3858725-a96b-41c5-a665-0d9f8cb5c97a req-a9be1b65-be2c-47f3-b6e5-9feac925e5d8 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c with Priority: HIGHEST for action security_group_members [ 886.960566] env[70006]: INFO networking_nsxv3.common.synchronization [req-f3858725-a96b-41c5-a665-0d9f8cb5c97a req-a9be1b65-be2c-47f3-b6e5-9feac925e5d8 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_rules [ 886.960735] env[70006]: INFO networking_nsxv3.common.synchronization [req-f3858725-a96b-41c5-a665-0d9f8cb5c97a req-a9be1b65-be2c-47f3-b6e5-9feac925e5d8 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 886.960874] env[70006]: INFO networking_nsxv3.common.synchronization [req-f3858725-a96b-41c5-a665-0d9f8cb5c97a req-a9be1b65-be2c-47f3-b6e5-9feac925e5d8 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: bb9049e5-2996-4128-866a-9998244adb75 with Priority: HIGHEST for action security_group_rules [ 886.960998] env[70006]: INFO networking_nsxv3.common.synchronization [req-f3858725-a96b-41c5-a665-0d9f8cb5c97a req-a9be1b65-be2c-47f3-b6e5-9feac925e5d8 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: bb9049e5-2996-4128-866a-9998244adb75 with Priority: HIGHEST for action security_group_members [ 886.961143] env[70006]: INFO networking_nsxv3.common.synchronization [req-f3858725-a96b-41c5-a665-0d9f8cb5c97a req-a9be1b65-be2c-47f3-b6e5-9feac925e5d8 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 95450791-e5ab-4650-be74-3d6299da9718 with Priority: HIGHEST for action port [ 886.961704] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c with Priority: HIGHEST for action security_group_rules [ 886.961842] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_rules [ 886.961939] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9049e5-2996-4128-866a-9998244adb75 with Priority: HIGHEST for action security_group_members [ 886.962044] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95450791-e5ab-4650-be74-3d6299da9718 with Priority: HIGHEST for action port [ 886.962135] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9049e5-2996-4128-866a-9998244adb75 with Priority: HIGHEST for action security_group_rules [ 886.962456] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c with Priority: HIGHEST for action security_group_members [ 886.962583] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 886.962908] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b0b1745-132f-45fa-b34f-f394a3502d5c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.963137] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.963137] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.963387] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.963387] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b0b1745-132f-45fa-b34f-f394a3502d5c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.964223] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.964313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.964838] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb9049e5-2996-4128-866a-9998244adb75 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.964938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.965155] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-95450791-e5ab-4650-be74-3d6299da9718 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.965291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.965329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.965536] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.965611] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95450791-e5ab-4650-be74-3d6299da9718',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.966374] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb9049e5-2996-4128-866a-9998244adb75 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.966469] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.966646] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b0b1745-132f-45fa-b34f-f394a3502d5c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.966729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.966901] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.967023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.134870] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c791268e-f7a5-438c-aaa7-f5cc925643c6 [ 887.134870] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.134870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.134870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.134870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.134870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.134870] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c791268e-f7a5-438c-aaa7-f5cc925643c6 already deleted. [ 887.134870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c791268e-f7a5-438c-aaa7-f5cc925643c6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.306074] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9049e5-2996-4128-866a-9998244adb75 in Status: SUCCESS [ 887.306305] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.307059] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 887.307324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.307395] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.307708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.307768] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.307925] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.307992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.308174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.308259] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.308347] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.309210] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb9049e5-2996-4128-866a-9998244adb75',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.309304] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.309467] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.309642] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.309776] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.309824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.309954] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.310047] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.310130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.310218] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.311150] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.311312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.311468] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.311641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.311641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.311765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.311843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.311929] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb9049e5-2996-4128-866a-9998244adb75',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.312584] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.312742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.312888] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.312990] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.314032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.314376] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.314473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.314604] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.355638] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b0b1745-132f-45fa-b34f-f394a3502d5c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.394368] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e45746ed-781c-4f14-807a-e9e8876db03b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.406029] env[70006]: INFO networking_nsxv3.common.synchronization [req-23956bd6-89e3-4399-aeda-f36f747f2f5b req-3194c1bb-c979-4706-9fa3-186f3b440419 tempest-ServerAddressesTestJSON-1300084773 tempest-ServerAddressesTestJSON-1300084773-project-member] Enqueued Resource ID: a703014b-177b-46b0-a1e5-010ba0dfd415 with Priority: HIGHEST for action security_group_members [ 887.408209] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a703014b-177b-46b0-a1e5-010ba0dfd415 with Priority: HIGHEST for action security_group_members [ 887.408209] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a703014b-177b-46b0-a1e5-010ba0dfd415 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.408209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.408209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.408209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.408209] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.408653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.408653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.408653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.408787] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.408905] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a703014b-177b-46b0-a1e5-010ba0dfd415',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.467920] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b0b1745-132f-45fa-b34f-f394a3502d5c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.468107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.468352] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95450791-e5ab-4650-be74-3d6299da9718 with status ACTIVE [ 887.468559] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.468723] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.468809] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.469232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.469276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.469524] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.469644] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.469783] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.470036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.470116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.470325] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.470458] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.471546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.471546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.471546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.471546] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95450791-e5ab-4650-be74-3d6299da9718 is going to be updated. [ 887.499059] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.499059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.499059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.499366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.499366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.499642] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95450791-e5ab-4650-be74-3d6299da9718" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.812893] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb9049e5-2996-4128-866a-9998244adb75',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.816736] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.819339] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.819573] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.820513] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb9049e5-2996-4128-866a-9998244adb75',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.858697] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b0b1745-132f-45fa-b34f-f394a3502d5c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.899895] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.899895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.899895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.900113] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.900230] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.900738] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45746ed-781c-4f14-807a-e9e8876db03b is going to be created. [ 887.912304] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.912304] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.912304] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.912858] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.913051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.913405] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.913652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.913757] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.913963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.914100] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.914254] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a703014b-177b-46b0-a1e5-010ba0dfd415 already deleted. [ 887.914405] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.932349] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.932516] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.932558] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.936280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.936280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.946474] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45746ed-781c-4f14-807a-e9e8876db03b in Status: UNINITIALIZED for 2s [ 887.981548] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.981548] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-822" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.981746] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-822" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.982043] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-822" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.982321] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.982480] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.982634] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.983013] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.983013] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.984044] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 887.984044] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.984044] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.984044] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.984044] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 887.984044] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.984044] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.004600] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.004780] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 888.004912] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.005327] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-822" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.005731] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-b1d1b3a0-6686-4faf-981e-6772c3a821dd taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.006018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-b1d1b3a0-6686-4faf-981e-6772c3a821dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.006215] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-b1d1b3a0-6686-4faf-981e-6772c3a821dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.006824] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-b1d1b3a0-6686-4faf-981e-6772c3a821dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.006824] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1d1b3a0-6686-4faf-981e-6772c3a821dd',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.247628] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: SUCCESS [ 888.247628] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.322444] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb9049e5-2996-4128-866a-9998244adb75: rpc.has_security_group_logging(os_id): False [ 888.323802] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.324685] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb9049e5-2996-4128-866a-9998244adb75',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.346882] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.347042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.347104] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.347546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.347707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.347883] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.347999] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.348075] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.348244] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.348519] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.348519] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb9049e5-2996-4128-866a-9998244adb75 is going to be created. [ 888.361423] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.361627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.361677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.362252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.362252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.362252] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c is going to be created. [ 888.388616] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.388616] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.388876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.388980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.389236] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.403454] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c in Status: UNINITIALIZED for 2s [ 888.439140] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.439279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.439279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.439511] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.439726] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.455271] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb9049e5-2996-4128-866a-9998244adb75 in Status: IN_PROGRESS for 2s [ 888.509923] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.510177] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.510313] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.510597] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.510755] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.511169] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port b1d1b3a0-6686-4faf-981e-6772c3a821dd not found, creating... [ 888.511474] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.511643] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.511766] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.512015] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.512178] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.512527] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.513008] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.513158] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.513385] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.513525] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.513829] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: b1d1b3a0-6686-4faf-981e-6772c3a821dd is going to be created. [ 888.560661] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.560889] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.561047] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.561355] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.561592] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.561826] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-b1d1b3a0-6686-4faf-981e-6772c3a821dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.661080] env[70006]: INFO networking_nsxv3.common.synchronization [None req-0ad8b9a5-e3f1-4ea9-a6af-0015e53e0fbf None None] Enqueued Resource ID: 4799f896-3012-4506-932b-453420df14cb with Priority: HIGHEST for action port [ 888.661833] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4799f896-3012-4506-932b-453420df14cb with Priority: HIGHEST for action port [ 888.663639] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-4799f896-3012-4506-932b-453420df14cb taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.664083] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4799f896-3012-4506-932b-453420df14cb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.664348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4799f896-3012-4506-932b-453420df14cb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.664811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4799f896-3012-4506-932b-453420df14cb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.664915] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4799f896-3012-4506-932b-453420df14cb',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.830509] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.830509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.830509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.830509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.830509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.830509] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 888.830509] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.830509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.830906] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.831227] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.831454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.831633] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb9049e5-2996-4128-866a-9998244adb75 is going to be updated. [ 888.868222] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.868222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.868222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.868222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.868222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.868222] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.869053] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.869828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.870205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.871219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.882327] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 888.882327] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9049e5-2996-4128-866a-9998244adb75 in Status: IN_PROGRESS for 2s [ 889.168921] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4799f896-3012-4506-932b-453420df14cb [ 889.173022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.173022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.173022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.173022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.173022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.173022] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4799f896-3012-4506-932b-453420df14cb already deleted. [ 889.173022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4799f896-3012-4506-932b-453420df14cb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.332435] env[70006]: INFO networking_nsxv3.common.synchronization [req-23956bd6-89e3-4399-aeda-f36f747f2f5b req-89a38965-dff3-47c5-b416-17bffab712b1 service nova] Enqueued Resource ID: a703014b-177b-46b0-a1e5-010ba0dfd415 with Priority: HIGHEST for action security_group_rules [ 889.332435] env[70006]: INFO networking_nsxv3.common.synchronization [req-23956bd6-89e3-4399-aeda-f36f747f2f5b req-89a38965-dff3-47c5-b416-17bffab712b1 service nova] Enqueued Resource ID: a703014b-177b-46b0-a1e5-010ba0dfd415 with Priority: HIGHEST for action security_group_members [ 889.332784] env[70006]: INFO networking_nsxv3.common.synchronization [req-23956bd6-89e3-4399-aeda-f36f747f2f5b req-89a38965-dff3-47c5-b416-17bffab712b1 service nova] Enqueued Resource ID: b1d1b3a0-6686-4faf-981e-6772c3a821dd with Priority: HIGHEST for action port [ 889.333193] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a703014b-177b-46b0-a1e5-010ba0dfd415 with Priority: HIGHEST for action security_group_rules [ 889.333393] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a703014b-177b-46b0-a1e5-010ba0dfd415 with Priority: HIGHEST for action security_group_members [ 889.333453] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d1b3a0-6686-4faf-981e-6772c3a821dd with Priority: HIGHEST for action port [ 889.333734] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a703014b-177b-46b0-a1e5-010ba0dfd415 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.333880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.333915] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.334206] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.334299] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a703014b-177b-46b0-a1e5-010ba0dfd415',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.339328] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a703014b-177b-46b0-a1e5-010ba0dfd415 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.339328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.339328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.339328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.339328] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.339328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.339328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.339328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.339328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.339328] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a703014b-177b-46b0-a1e5-010ba0dfd415',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.339328] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1d1b3a0-6686-4faf-981e-6772c3a821dd taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.339328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1d1b3a0-6686-4faf-981e-6772c3a821dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.339328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1d1b3a0-6686-4faf-981e-6772c3a821dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.339328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1d1b3a0-6686-4faf-981e-6772c3a821dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.339328] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1d1b3a0-6686-4faf-981e-6772c3a821dd',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.837261] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a703014b-177b-46b0-a1e5-010ba0dfd415 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.837261] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.841405] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a703014b-177b-46b0-a1e5-010ba0dfd415',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.842408] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1d1b3a0-6686-4faf-981e-6772c3a821dd with status ACTIVE [ 889.846153] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.846153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.846153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.846153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.846153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.846153] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.846153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.846153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.846153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.846153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.846153] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.846153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.846153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.846153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.846153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.846153] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1d1b3a0-6686-4faf-981e-6772c3a821dd is going to be updated. [ 889.873488] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.873672] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.873754] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.873997] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.874194] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.874392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1d1b3a0-6686-4faf-981e-6772c3a821dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.978173] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45746ed-781c-4f14-807a-e9e8876db03b in Status: SUCCESS [ 889.978371] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.978550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.978763] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.978958] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.979798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.980048] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.980271] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.980370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.980474] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.980564] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e45746ed-781c-4f14-807a-e9e8876db03b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.215703] env[70006]: INFO networking_nsxv3.common.synchronization [req-c38e8bc8-4350-448e-a026-f26bb28dbf7f req-93dc0093-b1e3-417b-8c63-ff34def114b4 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: bb9049e5-2996-4128-866a-9998244adb75 with Priority: HIGHEST for action security_group_members [ 890.215703] env[70006]: INFO networking_nsxv3.common.synchronization [req-c38e8bc8-4350-448e-a026-f26bb28dbf7f req-93dc0093-b1e3-417b-8c63-ff34def114b4 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 890.215703] env[70006]: INFO networking_nsxv3.common.synchronization [req-c38e8bc8-4350-448e-a026-f26bb28dbf7f req-93dc0093-b1e3-417b-8c63-ff34def114b4 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c with Priority: HIGHEST for action security_group_members [ 890.216502] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9049e5-2996-4128-866a-9998244adb75 with Priority: HIGHEST for action security_group_members [ 890.216765] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 890.217022] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c with Priority: HIGHEST for action security_group_members [ 890.217478] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb9049e5-2996-4128-866a-9998244adb75 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.217742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.218226] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.218456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.218744] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b0b1745-132f-45fa-b34f-f394a3502d5c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.218935] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.349329] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a703014b-177b-46b0-a1e5-010ba0dfd415',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.413820] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c in Status: SUCCESS [ 890.414078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.414253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.414473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.414661] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.414780] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.414845] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.414992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.415089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.415184] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b0b1745-132f-45fa-b34f-f394a3502d5c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.467253] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb9049e5-2996-4128-866a-9998244adb75 in Status: SUCCESS [ 890.467492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.467662] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.467881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.468133] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb9049e5-2996-4128-866a-9998244adb75',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.482628] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e45746ed-781c-4f14-807a-e9e8876db03b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.855202] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.855361] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.855438] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.855663] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.855759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.855858] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a703014b-177b-46b0-a1e5-010ba0dfd415 is going to be created. [ 890.881729] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.881880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.881950] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.882178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.882348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.895266] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9049e5-2996-4128-866a-9998244adb75 in Status: SUCCESS [ 890.895490] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.897166] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 890.897166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.897166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.897166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.897166] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.897166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.897166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.897467] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.897467] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.897467] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb9049e5-2996-4128-866a-9998244adb75',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.901938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.901938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.901938] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.901938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.901938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.901938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.901938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.901938] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.901938] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a703014b-177b-46b0-a1e5-010ba0dfd415 in Status: UNINITIALIZED for 2s [ 890.918700] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.918857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.918949] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.919184] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.919282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.919487] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.919584] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.919644] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.919794] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.919870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.919981] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c is going to be deleted. [ 890.972900] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.973045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.973126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.973342] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.973443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.973546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.974895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.975184] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.975392] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.975509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.975618] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.975716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.975797] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.975893] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b0b1745-132f-45fa-b34f-f394a3502d5c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.985231] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e45746ed-781c-4f14-807a-e9e8876db03b: rpc.has_security_group_logging(os_id): False [ 891.011029] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.011029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.011029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.011029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.011029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.011029] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb9049e5-2996-4128-866a-9998244adb75 is going to be deleted. [ 891.011582] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.011837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.012013] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.012321] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.012525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.012872] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.013125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.013282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.013534] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.013712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.014054] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e45746ed-781c-4f14-807a-e9e8876db03b is going to be created. [ 891.097319] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.097319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.097319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.097319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.097319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.097319] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.097319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.097319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.098276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.098542] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.098779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.111126] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e45746ed-781c-4f14-807a-e9e8876db03b in Status: IN_PROGRESS for 2s [ 891.404022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.404022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.404022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.404022] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb9049e5-2996-4128-866a-9998244adb75 is going to be deleted. [ 891.404022] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.433405] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.436210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.436210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.436210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.436210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.436210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.436210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.436210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.436210] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.436210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.436210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.436210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.436210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.436210] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb9049e5-2996-4128-866a-9998244adb75',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.482022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.482022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.482022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.482022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.482022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.482022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.482022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.482022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.482022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.482022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.482022] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c already deleted. [ 891.482022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.482022] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b0b1745-132f-45fa-b34f-f394a3502d5c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.482022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.482022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.482022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.482850] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.482850] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.484122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.484122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.484122] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b0b1745-132f-45fa-b34f-f394a3502d5c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.908419] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.938651] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.938818] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.938818] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.938983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.940242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.940242] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.940242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.940242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.940242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.940242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.940242] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb9049e5-2996-4128-866a-9998244adb75 already deleted. [ 891.940242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb9049e5-2996-4128-866a-9998244adb75" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.990690] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b0b1745-132f-45fa-b34f-f394a3502d5c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.990690] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.990690] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.990690] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.990690] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.990690] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.990690] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.990690] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.990690] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.990690] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.990690] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.990690] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c already deleted. [ 891.990690] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.411536] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.411889] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.411889] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.411988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.412224] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.412224] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 892.442593] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.445966] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.445966] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.445966] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.445966] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.454717] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 892.491382] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b0b1745-132f-45fa-b34f-f394a3502d5c: rpc.has_security_group_logging(os_id): False [ 892.510056] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.510056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.510056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.510460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.510460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.510754] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.510929] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.511054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.511261] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.511389] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.511559] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c is going to be created. [ 892.530703] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/5b0b1745-132f-45fa-b34f-f394a3502d5c], does not exist path=[/infra/domains/default/groups/5b0b1745-132f-45fa-b34f-f394a3502d5c]."\n}' [ 892.530825] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5b0b1745-132f-45fa-b34f-f394a3502d5c [ 892.530908] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 892.572575] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.572575] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.572575] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.572575] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.572799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.572980] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.573094] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.573152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.573348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.573420] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.573620] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.573714] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.573761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.573904] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.573979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.574078] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b0b1745-132f-45fa-b34f-f394a3502d5c is going to be created. [ 892.595970] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/5b0b1745-132f-45fa-b34f-f394a3502d5c], does not exist path=[/infra/domains/default/groups/5b0b1745-132f-45fa-b34f-f394a3502d5c]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5b0b1745-132f-45fa-b34f-f394a3502d5c [ 892.595970] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b0b1745-132f-45fa-b34f-f394a3502d5c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.595970] env[70006]: Traceback (most recent call last): [ 892.595970] env[70006]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 892.595970] env[70006]: return func(*args, **kwargs) [ 892.595970] env[70006]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 892.595970] env[70006]: res.raise_for_status() [ 892.595970] env[70006]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 892.595970] env[70006]: raise HTTPError(http_error_msg, response=self) [ 892.595970] env[70006]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5b0b1745-132f-45fa-b34f-f394a3502d5c [ 892.595970] env[70006]: During handling of the above exception, another exception occurred: [ 892.595970] env[70006]: Traceback (most recent call last): [ 892.595970] env[70006]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 892.595970] env[70006]: listener.cb(fileno) [ 892.595970] env[70006]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 892.595970] env[70006]: result = function(*args, **kwargs) [ 892.595970] env[70006]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 892.595970] env[70006]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 892.595970] env[70006]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 892.595970] env[70006]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 892.595970] env[70006]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 892.595970] env[70006]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 892.595970] env[70006]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 892.595970] env[70006]: res.raise_for_status() [ 892.595970] env[70006]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 892.595970] env[70006]: raise HTTPError(http_error_msg, response=self) [ 892.595970] env[70006]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5b0b1745-132f-45fa-b34f-f394a3502d5c [ 892.595970] env[70006]: Removing descriptor: 5 [ 892.738298] env[70006]: INFO networking_nsxv3.common.synchronization [req-456faabb-7d57-41f5-ba8b-f03aba773d54 req-f5ac280a-c617-4c3f-a124-03f42f76c97b tempest-ImagesTestJSON-196229908 tempest-ImagesTestJSON-196229908-project-member] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 892.738298] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 892.738298] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.738298] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.738298] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.738298] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.738298] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.738298] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.738844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.739191] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.739437] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.739670] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.914127] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a703014b-177b-46b0-a1e5-010ba0dfd415 in Status: SUCCESS [ 892.914127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.914127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.914127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.914127] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.914127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.914127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.914127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.914127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.914127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.914127] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a703014b-177b-46b0-a1e5-010ba0dfd415',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.030879] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.030879] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.030879] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.030879] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.032556] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.032556] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.032556] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.032813] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.032865] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.033069] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.033173] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.033299] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.033410] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.033532] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.033642] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.033775] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.053388] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.053621] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 893.053693] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.053850] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.054195] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-f777b44c-5cf6-4ccb-86d9-15dad465d158 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.054377] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-f777b44c-5cf6-4ccb-86d9-15dad465d158" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.054498] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-f777b44c-5cf6-4ccb-86d9-15dad465d158" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.054820] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-f777b44c-5cf6-4ccb-86d9-15dad465d158" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.054963] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f777b44c-5cf6-4ccb-86d9-15dad465d158',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.123884] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e45746ed-781c-4f14-807a-e9e8876db03b in Status: SUCCESS [ 893.124162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.243875] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.243875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.243875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.243875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.274124] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.274124] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.274124] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.274124] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.274124] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.274124] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.274124] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be updated. [ 893.299312] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.299312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.299493] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.300666] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.300666] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.313279] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: IN_PROGRESS for 2s [ 893.420125] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a703014b-177b-46b0-a1e5-010ba0dfd415 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.420125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.420125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.420125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.420125] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.420125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.420125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.420125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.420125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.420125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.420125] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a703014b-177b-46b0-a1e5-010ba0dfd415 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.420125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.420125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.420125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.420125] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.420125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.421417] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.421417] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.421417] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.421417] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.421417] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a703014b-177b-46b0-a1e5-010ba0dfd415',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.557848] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.558155] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.558322] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.558612] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.559452] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.559653] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port f777b44c-5cf6-4ccb-86d9-15dad465d158 not found, creating... [ 893.560067] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.560259] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.560385] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.560662] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.560820] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.561166] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.561580] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.561580] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.561716] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.561804] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.561944] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: f777b44c-5cf6-4ccb-86d9-15dad465d158 is going to be created. [ 893.584433] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.584715] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.584869] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.585199] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.585532] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.585799] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-f777b44c-5cf6-4ccb-86d9-15dad465d158" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.924229] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a703014b-177b-46b0-a1e5-010ba0dfd415: rpc.has_security_group_logging(os_id): False [ 893.944785] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.945093] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.945093] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.945355] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.945451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.945661] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.945793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.948117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.948117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.948117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.948117] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.948117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.948117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.948117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.948117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.948117] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.948117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.948117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.948117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.948117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.948117] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a703014b-177b-46b0-a1e5-010ba0dfd415 is going to be created. [ 894.024602] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.027028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.027028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.027028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.027028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.040960] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a703014b-177b-46b0-a1e5-010ba0dfd415 in Status: IN_PROGRESS for 2s [ 894.356001] env[70006]: INFO networking_nsxv3.common.synchronization [req-456faabb-7d57-41f5-ba8b-f03aba773d54 req-4f392c74-5a78-4d43-97c2-719fa76719c4 service nova] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_rules [ 894.357250] env[70006]: INFO networking_nsxv3.common.synchronization [req-456faabb-7d57-41f5-ba8b-f03aba773d54 req-4f392c74-5a78-4d43-97c2-719fa76719c4 service nova] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 894.359264] env[70006]: INFO networking_nsxv3.common.synchronization [req-456faabb-7d57-41f5-ba8b-f03aba773d54 req-4f392c74-5a78-4d43-97c2-719fa76719c4 service nova] Enqueued Resource ID: f777b44c-5cf6-4ccb-86d9-15dad465d158 with Priority: HIGHEST for action port [ 894.360503] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_rules [ 894.363023] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 894.363023] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f777b44c-5cf6-4ccb-86d9-15dad465d158 with Priority: HIGHEST for action port [ 894.363023] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.363023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.363023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.363023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.363023] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.363023] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.363023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.364398] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-f777b44c-5cf6-4ccb-86d9-15dad465d158 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.364765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f777b44c-5cf6-4ccb-86d9-15dad465d158" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.364974] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f777b44c-5cf6-4ccb-86d9-15dad465d158" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.365392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f777b44c-5cf6-4ccb-86d9-15dad465d158" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.365590] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f777b44c-5cf6-4ccb-86d9-15dad465d158',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.467032] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 894.467032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.467032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.467032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.467032] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.467032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.467032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.467032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.467032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.467032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.468541] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.469084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.469454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.469823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.470291] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.470565] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.472709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.472709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.472709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.472709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.472709] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.472709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.472709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.472709] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.472709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.472709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.472709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.475382] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.475519] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.870283] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.870283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.870283] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f777b44c-5cf6-4ccb-86d9-15dad465d158 with status ACTIVE [ 894.870283] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.870283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.870283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.870283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.870283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.870283] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.870283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.870283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.870283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.870283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.870283] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.870870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.870870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.870870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.870870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.870870] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f777b44c-5cf6-4ccb-86d9-15dad465d158 is going to be updated. [ 894.895021] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.895402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.895402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.895614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.895771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.895937] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f777b44c-5cf6-4ccb-86d9-15dad465d158" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.977838] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6: rpc.has_security_group_logging(os_id): False [ 894.979180] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.006166] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.006166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.006166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.006423] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.036400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.036526] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.036669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.036734] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.037142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.037258] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.037484] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.037609] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.037689] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.037901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.038037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.038258] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.038402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.038467] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.038659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.038708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.038771] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 895.132617] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.132617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.132617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.132617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.132617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.153327] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 895.323032] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 895.325456] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 deletion is rescheduled due to dependency. [ 895.325456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.325456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.325456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.325456] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.325456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.325456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.325456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.325456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.325456] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.483200] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.831480] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.985722] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.985878] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.985950] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.986266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.986333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.986401] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 896.014842] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.014993] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.015080] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.015285] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.015456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.026978] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 896.052834] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a703014b-177b-46b0-a1e5-010ba0dfd415 in Status: SUCCESS [ 896.052834] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.333890] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.836787] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.837448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.837448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.837448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.837588] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.838921] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be updated. [ 896.868667] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.868851] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.868888] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.869118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.869335] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.883104] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: IN_PROGRESS for 2s [ 897.182984] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 897.183076] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.183516] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.183766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.183857] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.688063] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.688063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.038066] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 898.038354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.038496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.038857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.038967] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.039035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.039079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.039405] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.039405] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.039405] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.039662] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.545827] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.545827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.546092] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.546289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.546357] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.546420] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.546487] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.546642] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.546825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.547070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.547296] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.547378] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.547479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.547590] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.547731] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.547827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.547891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.548065] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.548156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.548241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.548329] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.895129] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 898.895464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.895713] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.896053] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.897085] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.897277] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.897384] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.897637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.897763] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.897905] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.898164] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.050316] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6: rpc.has_security_group_logging(os_id): False [ 899.068566] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.068791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.068791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.069332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.069332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.069505] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.069505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.069677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.071107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.071107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.071107] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.071107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.071107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.071107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.071107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.071107] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.071107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.071107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.071107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.071107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.071107] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 899.131800] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.131976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.132030] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.132360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.132464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.149166] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 899.362317] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 899.362661] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 899.403963] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.403963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.403963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.403963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.403963] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.403963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.403963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.403963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.403963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.403963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.403963] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.403963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.403963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.403963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.403963] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.403963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.407465] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.407465] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.407465] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.407465] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.407465] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.446784] env[70006]: INFO networking_nsxv3.common.synchronization [req-6d076486-1029-4d06-98fb-9a46b1764b81 req-0177a073-b8e1-42af-8ad6-51f73eab2d43 tempest-MultipleCreateTestJSON-373751725 tempest-MultipleCreateTestJSON-373751725-project-member] Enqueued Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_members [ 899.447173] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_members [ 899.451021] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.451021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.451021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.451021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.451021] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.451021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.451021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.451021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.451021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.451021] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.807593] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.808359] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-258" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.808751] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-258" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.809228] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-258" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.809660] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.810033] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.810336] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.810804] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.811120] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.811460] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.812837] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.812837] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.812837] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.812837] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.812837] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.812837] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.833909] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.834441] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.834441] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.834441] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-258" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.834669] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-c7d197fd-939c-426a-b373-674e428f6655 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.834880] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-c7d197fd-939c-426a-b373-674e428f6655" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.835140] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-c7d197fd-939c-426a-b373-674e428f6655" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.835411] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-c7d197fd-939c-426a-b373-674e428f6655" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.835579] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7d197fd-939c-426a-b373-674e428f6655',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.908790] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46e7bb0e-3b0b-455c-8638-3cb59c191bf9: rpc.has_security_group_logging(os_id): False [ 899.931395] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.931559] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.931632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.931862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.931976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.932250] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.932436] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.932506] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.932716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.932823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.933158] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.933299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.933379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.933567] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.933652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.933895] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.934256] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.934386] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.935707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.935707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.935707] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be updated. [ 899.953043] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.953043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.953043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.953332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.953332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.953395] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.953514] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.953514] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.953788] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.953788] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.953862] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 already deleted. [ 899.953927] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.002041] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.002041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.002041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.002041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.002041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.018986] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: IN_PROGRESS for 2s [ 900.339066] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.339066] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.339469] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.339510] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.339721] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.339893] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port c7d197fd-939c-426a-b373-674e428f6655 not found, creating... [ 900.340266] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.340440] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.340567] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.340819] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.340988] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.341322] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.341489] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.341610] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.341839] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.341979] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.342143] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: c7d197fd-939c-426a-b373-674e428f6655 is going to be created. [ 900.363789] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.364053] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.364147] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.364442] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.364676] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.365201] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-c7d197fd-939c-426a-b373-674e428f6655" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.171741] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 901.171741] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.272679] env[70006]: INFO networking_nsxv3.common.synchronization [req-6d076486-1029-4d06-98fb-9a46b1764b81 req-5e156f53-6134-4b29-acfe-2daddad8bf31 service nova] Enqueued Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_rules [ 901.272679] env[70006]: INFO networking_nsxv3.common.synchronization [req-6d076486-1029-4d06-98fb-9a46b1764b81 req-5e156f53-6134-4b29-acfe-2daddad8bf31 service nova] Enqueued Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_members [ 901.272825] env[70006]: INFO networking_nsxv3.common.synchronization [req-6d076486-1029-4d06-98fb-9a46b1764b81 req-5e156f53-6134-4b29-acfe-2daddad8bf31 service nova] Enqueued Resource ID: c7d197fd-939c-426a-b373-674e428f6655 with Priority: HIGHEST for action port [ 901.273463] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_rules [ 901.273595] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_members [ 901.274509] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d197fd-939c-426a-b373-674e428f6655 with Priority: HIGHEST for action port [ 901.274979] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.275162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.275233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.275505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.275595] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.277242] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.277337] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.277459] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.277659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.277918] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.280866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.281139] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.281366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.281460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.281854] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.282562] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7d197fd-939c-426a-b373-674e428f6655 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.282687] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7d197fd-939c-426a-b373-674e428f6655" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.282749] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7d197fd-939c-426a-b373-674e428f6655" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.282934] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7d197fd-939c-426a-b373-674e428f6655" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.283111] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7d197fd-939c-426a-b373-674e428f6655',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.788487] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.791206] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.791206] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.792038] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7d197fd-939c-426a-b373-674e428f6655 with status ACTIVE [ 901.792270] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.792435] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.792527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.792753] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.792965] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.793955] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.793955] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.793955] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.793955] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.793955] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.794324] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.794324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.794324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.794478] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.794588] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.794683] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7d197fd-939c-426a-b373-674e428f6655 is going to be updated. [ 901.823703] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.823987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.823987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.824293] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.824713] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.825976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7d197fd-939c-426a-b373-674e428f6655" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.036406] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 902.036784] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.101669] env[70006]: INFO networking_nsxv3.common.synchronization [req-6d076486-1029-4d06-98fb-9a46b1764b81 req-98450d39-10fc-4518-887d-2e2c1a17991e tempest-MultipleCreateTestJSON-373751725 tempest-MultipleCreateTestJSON-373751725-project-member] Enqueued Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_members [ 902.103122] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_members [ 902.103441] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.103620] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.292301] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.601519] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-258 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.601954] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-258" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.601954] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-258" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.602187] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-258" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.602380] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.602537] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.602657] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.602874] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.603043] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.603248] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.603847] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.603847] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.603847] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.603847] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.603847] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.604070] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.626139] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.626139] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 902.626139] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.626139] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-258" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.626139] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-7825762a-5525-4c92-8146-1ac33ba295f6 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.626139] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-7825762a-5525-4c92-8146-1ac33ba295f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.626139] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-7825762a-5525-4c92-8146-1ac33ba295f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.626139] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-7825762a-5525-4c92-8146-1ac33ba295f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.626139] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7825762a-5525-4c92-8146-1ac33ba295f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.794953] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.795317] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.795317] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.795583] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.795697] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.795837] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 is going to be created. [ 902.822920] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.823125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.823184] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.823347] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.823509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.838034] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 in Status: UNINITIALIZED for 2s [ 903.129906] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.130255] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.130890] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.130890] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.130890] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.131107] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 7825762a-5525-4c92-8146-1ac33ba295f6 not found, creating... [ 903.131410] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.131523] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.131605] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.131840] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.131981] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.132276] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.132508] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.132686] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.132877] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.133020] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.133165] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 7825762a-5525-4c92-8146-1ac33ba295f6 is going to be created. [ 903.157858] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.158161] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.158319] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.158682] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.159353] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.159353] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-7825762a-5525-4c92-8146-1ac33ba295f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.456841] env[70006]: INFO networking_nsxv3.common.synchronization [req-85b0d15c-321e-423a-bd0c-cc3265bcbefe req-6c8705ee-b084-481c-aeeb-7db4ed46d635 tempest-ServerAddressesTestJSON-1300084773 tempest-ServerAddressesTestJSON-1300084773-project-member] Enqueued Resource ID: a703014b-177b-46b0-a1e5-010ba0dfd415 with Priority: HIGHEST for action security_group_members [ 904.457941] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a703014b-177b-46b0-a1e5-010ba0dfd415 with Priority: HIGHEST for action security_group_members [ 904.462038] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a703014b-177b-46b0-a1e5-010ba0dfd415 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.464702] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.464802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.465079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.465401] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.465401] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.465538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.465617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.465708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.465811] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a703014b-177b-46b0-a1e5-010ba0dfd415',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.468418] env[70006]: INFO networking_nsxv3.common.synchronization [req-6d076486-1029-4d06-98fb-9a46b1764b81 req-4014c244-d110-4319-bbdd-648371fe716f service nova] Enqueued Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_rules [ 904.468632] env[70006]: INFO networking_nsxv3.common.synchronization [req-6d076486-1029-4d06-98fb-9a46b1764b81 req-4014c244-d110-4319-bbdd-648371fe716f service nova] Enqueued Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_members [ 904.468689] env[70006]: INFO networking_nsxv3.common.synchronization [req-6d076486-1029-4d06-98fb-9a46b1764b81 req-4014c244-d110-4319-bbdd-648371fe716f service nova] Enqueued Resource ID: 7825762a-5525-4c92-8146-1ac33ba295f6 with Priority: HIGHEST for action port [ 904.469899] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_rules [ 904.470089] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_members [ 904.470451] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7825762a-5525-4c92-8146-1ac33ba295f6 with Priority: HIGHEST for action port [ 904.470757] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.470854] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.471077] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.471659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.471731] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-7825762a-5525-4c92-8146-1ac33ba295f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.471845] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7825762a-5525-4c92-8146-1ac33ba295f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.471900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7825762a-5525-4c92-8146-1ac33ba295f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.472092] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7825762a-5525-4c92-8146-1ac33ba295f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.472170] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7825762a-5525-4c92-8146-1ac33ba295f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.846821] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 in Status: SUCCESS [ 904.848977] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.848977] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.848977] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.848977] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.848977] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.848977] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.848977] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.848977] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.848977] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.849525] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.850804] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.851041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.851270] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.851421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.851519] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.851904] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.852053] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.853023] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.901516] env[70006]: INFO networking_nsxv3.common.synchronization [None req-92d5218f-1a29-4218-b66e-bd7166a58d84 None None] Enqueued Resource ID: 476a1d0b-827d-4efe-899c-c26d1c365994 with Priority: HIGHEST for action port [ 904.902086] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 476a1d0b-827d-4efe-899c-c26d1c365994 with Priority: HIGHEST for action port [ 904.902402] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-476a1d0b-827d-4efe-899c-c26d1c365994 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.902517] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-476a1d0b-827d-4efe-899c-c26d1c365994" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.902601] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-476a1d0b-827d-4efe-899c-c26d1c365994" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.902834] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-476a1d0b-827d-4efe-899c-c26d1c365994" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.902918] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('476a1d0b-827d-4efe-899c-c26d1c365994',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.970470] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.970618] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.970694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.970912] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.971144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.971426] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.971545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.971614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.971799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.971888] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.971984] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a703014b-177b-46b0-a1e5-010ba0dfd415 is going to be updated. [ 904.974676] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7825762a-5525-4c92-8146-1ac33ba295f6 with status ACTIVE [ 904.974858] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.974997] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.975086] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.975289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.975403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.975600] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.975729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.975822] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.976051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.976176] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.976427] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.976565] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.976650] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.976846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.976947] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.977076] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7825762a-5525-4c92-8146-1ac33ba295f6 is going to be updated. [ 905.002170] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.002170] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.002367] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.002411] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.002556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.002712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7825762a-5525-4c92-8146-1ac33ba295f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.006866] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.006866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.006866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.006866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.006866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.015662] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a703014b-177b-46b0-a1e5-010ba0dfd415 in Status: IN_PROGRESS for 2s [ 905.353804] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.353956] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.355238] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.404792] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 476a1d0b-827d-4efe-899c-c26d1c365994 [ 905.405039] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.405225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.405268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.405485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.405577] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.405672] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:476a1d0b-827d-4efe-899c-c26d1c365994 already deleted. [ 905.405756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-476a1d0b-827d-4efe-899c-c26d1c365994" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.857278] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.363144] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.363329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.363405] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.363684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.363721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.363845] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 is going to be updated. [ 906.402819] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.403010] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.403106] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.403701] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.404356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.417772] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 in Status: IN_PROGRESS for 2s [ 907.031267] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a703014b-177b-46b0-a1e5-010ba0dfd415 in Status: SUCCESS [ 907.031957] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a703014b-177b-46b0-a1e5-010ba0dfd415 deletion is rescheduled due to dependency. [ 907.031957] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.678940] env[70006]: INFO networking_nsxv3.common.synchronization [None req-9cf24841-fee9-4644-a721-ec726907ab64 None None] Enqueued Resource ID: 32aec78a-1095-4583-9de1-5ad59b41ec20 with Priority: HIGHEST for action port [ 907.679086] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32aec78a-1095-4583-9de1-5ad59b41ec20 with Priority: HIGHEST for action port [ 907.679570] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-32aec78a-1095-4583-9de1-5ad59b41ec20 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.679737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32aec78a-1095-4583-9de1-5ad59b41ec20" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.679776] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32aec78a-1095-4583-9de1-5ad59b41ec20" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.680103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32aec78a-1095-4583-9de1-5ad59b41ec20" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.680210] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32aec78a-1095-4583-9de1-5ad59b41ec20',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.183065] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32aec78a-1095-4583-9de1-5ad59b41ec20 [ 908.183065] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.183065] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.183065] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.183065] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.183065] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.183065] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32aec78a-1095-4583-9de1-5ad59b41ec20 already deleted. [ 908.183065] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32aec78a-1095-4583-9de1-5ad59b41ec20" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.432253] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 in Status: SUCCESS [ 908.432475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.432684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.432923] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.433169] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.433290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.433364] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.433521] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.433601] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.433712] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.937058] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.438682] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.943280] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.943381] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.943457] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.943622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.943734] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.943811] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 is going to be updated. [ 909.978418] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.978585] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.978668] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.978884] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.979045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.989978] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 in Status: IN_PROGRESS for 2s [ 912.003081] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 in Status: SUCCESS [ 912.003081] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.003418] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.003418] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.003641] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.003832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.003832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.004016] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.004152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.004277] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.004543] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.004543] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.004714] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.004760] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.004881] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.004973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.005062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.005227] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.005312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.005401] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.005493] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.509182] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7: rpc.has_security_group_logging(os_id): False [ 912.532026] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.532026] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.532026] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.532026] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.532026] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.532500] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.532500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.532500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.532847] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.532847] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.533051] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.533051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.533157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.533223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.533292] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.533483] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.533620] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.533695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.533829] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.533922] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.534061] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 is going to be created. [ 912.613416] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.613666] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.613666] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.613841] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.614041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.626187] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 in Status: IN_PROGRESS for 2s [ 912.679570] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 912.679680] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 913.873969] env[70006]: INFO networking_nsxv3.common.synchronization [req-17e72379-b537-4ea5-b4fe-df1053edec3d req-dd6edbbf-7494-4721-9e49-1e49156846cc tempest-VolumesAdminNegativeTest-932475284 tempest-VolumesAdminNegativeTest-932475284-project-member] Enqueued Resource ID: 2695bb32-670b-49f4-b84e-274269e20fe5 with Priority: HIGHEST for action security_group_members [ 913.874829] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2695bb32-670b-49f4-b84e-274269e20fe5 with Priority: HIGHEST for action security_group_members [ 913.876593] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-2695bb32-670b-49f4-b84e-274269e20fe5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.876593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.876593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.876593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.876593] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.876967] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.876967] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.876967] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.877202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.877352] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2695bb32-670b-49f4-b84e-274269e20fe5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.381017] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.381207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.381207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.381512] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.405741] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.406563] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.406563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.406563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.406563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.406798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.406798] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2695bb32-670b-49f4-b84e-274269e20fe5 is going to be updated. [ 914.447287] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.447508] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.447587] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.447795] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.447957] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.460845] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2695bb32-670b-49f4-b84e-274269e20fe5 in Status: IN_PROGRESS for 2s [ 914.646205] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 in Status: SUCCESS [ 914.646495] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.647109] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.647377] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.647529] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.149755] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.150207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.150207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.150310] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.151471] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.151471] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.151471] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.151471] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.151471] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.151471] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.151471] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.654452] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.654452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.654452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.654452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.654452] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.654452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.654452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.654452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.654452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.654452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.654452] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.654452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.654452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.654452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.655268] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.655268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.655268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.655268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.655268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.655268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.655268] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.793897] env[70006]: INFO networking_nsxv3.common.synchronization [req-3e04809d-1f13-4f6d-82ba-116451981839 req-3c69948d-f146-404d-9768-b37fd8c45455 tempest-MultipleCreateTestJSON-373751725 tempest-MultipleCreateTestJSON-373751725-project-member] Enqueued Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_members [ 915.794645] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_members [ 915.795113] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.795342] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.795406] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.795635] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.795826] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.795936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.796047] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.796299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.796460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.796619] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.864632] env[70006]: INFO networking_nsxv3.common.synchronization [req-508b6676-f9ca-49a9-8421-57db8e3c63d8 req-01d8baac-3c94-4758-ad57-1d8f23c97778 tempest-MultipleCreateTestJSON-373751725 tempest-MultipleCreateTestJSON-373751725-project-member] Enqueued Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_members [ 915.865243] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGHEST for action security_group_members [ 915.865549] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.865650] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.157169] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7: rpc.has_security_group_logging(os_id): False [ 916.181612] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.181839] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.182018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.182185] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.182301] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.182624] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.182784] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.182828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.183043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.186427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.186427] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.186427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.186427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.186427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.186427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.186427] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.186427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.186427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.186427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.186427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.186427] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 is going to be updated. [ 916.274672] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.274880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.275037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.275308] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.275554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.294547] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 in Status: IN_PROGRESS for 2s [ 916.307212] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.473366] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2695bb32-670b-49f4-b84e-274269e20fe5 in Status: SUCCESS [ 916.474579] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2695bb32-670b-49f4-b84e-274269e20fe5 deletion is rescheduled due to dependency. [ 916.474579] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.809522] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.311942] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.312292] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.312292] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.312462] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.313323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.313323] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 is going to be updated. [ 917.343480] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.343767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.343864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.344161] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.344335] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.357291] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 in Status: IN_PROGRESS for 2s [ 918.078434] env[70006]: INFO networking_nsxv3.common.synchronization [None req-4f23dbd4-bdda-4b12-9ef5-cd2d92619209 tempest-ServerRescueNegativeTestJSON-1434609939 tempest-ServerRescueNegativeTestJSON-1434609939-project-member] Enqueued Resource ID: 4366a46c-c412-4f29-aff2-8a2ec0ee4a11 with Priority: HIGHEST for action security_group_rules [ 918.078990] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4366a46c-c412-4f29-aff2-8a2ec0ee4a11 with Priority: HIGHEST for action security_group_rules [ 918.079623] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4366a46c-c412-4f29-aff2-8a2ec0ee4a11 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.079623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4366a46c-c412-4f29-aff2-8a2ec0ee4a11" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.079623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4366a46c-c412-4f29-aff2-8a2ec0ee4a11" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.079911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4366a46c-c412-4f29-aff2-8a2ec0ee4a11" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.079911] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4366a46c-c412-4f29-aff2-8a2ec0ee4a11',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.157137] env[70006]: INFO networking_nsxv3.common.synchronization [None req-c7e27a91-45cf-4b80-ad21-c94405515dc2 tempest-ServerRescueNegativeTestJSON-1434609939 tempest-ServerRescueNegativeTestJSON-1434609939-project-member] Enqueued Resource ID: 4366a46c-c412-4f29-aff2-8a2ec0ee4a11 with Priority: HIGHEST for action security_group_rules [ 918.157756] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4366a46c-c412-4f29-aff2-8a2ec0ee4a11 with Priority: HIGHEST for action security_group_rules [ 918.158216] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4366a46c-c412-4f29-aff2-8a2ec0ee4a11 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.158299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4366a46c-c412-4f29-aff2-8a2ec0ee4a11" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.310935] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 in Status: SUCCESS [ 918.310935] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.604140] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.604652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.604652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.604652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.605036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.605036] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4366a46c-c412-4f29-aff2-8a2ec0ee4a11 already deleted. [ 918.605036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4366a46c-c412-4f29-aff2-8a2ec0ee4a11" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.605254] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4366a46c-c412-4f29-aff2-8a2ec0ee4a11" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.605433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4366a46c-c412-4f29-aff2-8a2ec0ee4a11" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.605433] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4366a46c-c412-4f29-aff2-8a2ec0ee4a11',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.130289] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.130448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.130502] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.130712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.130796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.130886] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4366a46c-c412-4f29-aff2-8a2ec0ee4a11 already deleted. [ 919.132104] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4366a46c-c412-4f29-aff2-8a2ec0ee4a11" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.368058] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 in Status: SUCCESS [ 919.368401] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.368586] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.368872] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.369042] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.369167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.369239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.369390] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.369477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.369577] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.873157] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.873509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.873509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.873656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.873739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.873961] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.874566] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.874566] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.874566] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.874566] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.874566] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 is going to be updated. [ 919.903947] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.904183] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.904276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.904644] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.904868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.919344] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 in Status: IN_PROGRESS for 2s [ 921.718408] env[70006]: INFO networking_nsxv3.common.synchronization [None req-ba59023e-072a-4533-9a8b-5646158cf3fa None None] Enqueued Resource ID: a1559452-0ef4-4634-a118-b92e5d81218a with Priority: HIGHEST for action port [ 921.718794] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1559452-0ef4-4634-a118-b92e5d81218a with Priority: HIGHEST for action port [ 921.719109] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1559452-0ef4-4634-a118-b92e5d81218a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.719236] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1559452-0ef4-4634-a118-b92e5d81218a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.719296] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1559452-0ef4-4634-a118-b92e5d81218a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.719604] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1559452-0ef4-4634-a118-b92e5d81218a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.719689] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1559452-0ef4-4634-a118-b92e5d81218a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.930293] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 in Status: SUCCESS [ 921.930293] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 deletion is rescheduled due to dependency. [ 921.930293] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.222037] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1559452-0ef4-4634-a118-b92e5d81218a [ 922.222037] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.222037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.222037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.222347] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.222475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.222607] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1559452-0ef4-4634-a118-b92e5d81218a already deleted. [ 922.222771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1559452-0ef4-4634-a118-b92e5d81218a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.773845] env[70006]: INFO networking_nsxv3.common.synchronization [None req-db5e3bbf-e242-4e4d-b030-772efd51d8cc None None] Enqueued Resource ID: 62a95518-aaf5-4949-a2a6-a889202d363a with Priority: HIGHEST for action port [ 922.775125] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62a95518-aaf5-4949-a2a6-a889202d363a with Priority: HIGHEST for action port [ 922.775568] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-62a95518-aaf5-4949-a2a6-a889202d363a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.775781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62a95518-aaf5-4949-a2a6-a889202d363a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.775781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62a95518-aaf5-4949-a2a6-a889202d363a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.776504] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62a95518-aaf5-4949-a2a6-a889202d363a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.777838] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62a95518-aaf5-4949-a2a6-a889202d363a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.930717] env[70006]: INFO networking_nsxv3.common.synchronization [req-1f013dab-9ff7-4ca6-8b13-08615d82106f req-a7e6ab8b-e7a9-4d40-ad10-2341d6b90556 tempest-AttachVolumeNegativeTest-242855104 tempest-AttachVolumeNegativeTest-242855104-project-member] Enqueued Resource ID: d4596cda-f889-4b1b-8e98-7effb27170e9 with Priority: HIGHEST for action security_group_members [ 922.931581] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4596cda-f889-4b1b-8e98-7effb27170e9 with Priority: HIGHEST for action security_group_members [ 922.931811] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4596cda-f889-4b1b-8e98-7effb27170e9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.931811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.931811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.931994] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.932815] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.932927] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.932988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.933182] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.933267] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.933622] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4596cda-f889-4b1b-8e98-7effb27170e9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.284344] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62a95518-aaf5-4949-a2a6-a889202d363a [ 923.285403] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.285403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.285403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.285403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.285403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.285666] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62a95518-aaf5-4949-a2a6-a889202d363a already deleted. [ 923.285666] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62a95518-aaf5-4949-a2a6-a889202d363a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.436617] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.436844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.436844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.437072] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.460057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.460057] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.460057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.460057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.460057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.460455] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.460455] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4596cda-f889-4b1b-8e98-7effb27170e9 is going to be updated. [ 923.493265] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.494566] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.494566] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.494566] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.495157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.506290] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4596cda-f889-4b1b-8e98-7effb27170e9 in Status: IN_PROGRESS for 2s [ 924.099144] env[70006]: INFO networking_nsxv3.common.synchronization [None req-0512560e-bb56-4c6f-b57e-9f6511eeb0c9 None None] Enqueued Resource ID: 65f40ee4-6c06-4004-9c6a-20c67da93511 with Priority: HIGHEST for action port [ 924.099144] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65f40ee4-6c06-4004-9c6a-20c67da93511 with Priority: HIGHEST for action port [ 924.099144] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-65f40ee4-6c06-4004-9c6a-20c67da93511 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.099144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65f40ee4-6c06-4004-9c6a-20c67da93511" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.099550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65f40ee4-6c06-4004-9c6a-20c67da93511" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.099550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65f40ee4-6c06-4004-9c6a-20c67da93511" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.099550] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65f40ee4-6c06-4004-9c6a-20c67da93511',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.410029] env[70006]: INFO networking_nsxv3.common.synchronization [req-bffcd130-56dc-488b-8758-a465b1102033 req-1b914a7f-90fb-4ffc-87fa-96c35d11e565 tempest-SecurityGroupRulesTestJSON-590804016 tempest-SecurityGroupRulesTestJSON-590804016-project-member] Enqueued Resource ID: 8b222292-9188-4e55-9856-368523b10cf0 with Priority: HIGHEST for action security_group_rules [ 924.410029] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b222292-9188-4e55-9856-368523b10cf0 with Priority: HIGHEST for action security_group_rules [ 924.412516] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b222292-9188-4e55-9856-368523b10cf0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.418034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b222292-9188-4e55-9856-368523b10cf0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.418034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b222292-9188-4e55-9856-368523b10cf0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.418034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b222292-9188-4e55-9856-368523b10cf0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.418034] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b222292-9188-4e55-9856-368523b10cf0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.602169] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65f40ee4-6c06-4004-9c6a-20c67da93511 [ 924.603885] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.603885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.603885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.603885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.603885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.604485] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65f40ee4-6c06-4004-9c6a-20c67da93511 already deleted. [ 924.604485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65f40ee4-6c06-4004-9c6a-20c67da93511" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.937309] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.938179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.938179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.938179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.938179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.938179] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b222292-9188-4e55-9856-368523b10cf0 already deleted. [ 924.938179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b222292-9188-4e55-9856-368523b10cf0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.941672] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.941754] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.941791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.942054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.942131] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.017204] env[70006]: INFO networking_nsxv3.common.synchronization [req-52517634-fdf2-494c-8359-52b97cb4080e req-1c3b9e61-dbb8-4261-8577-4500697f965c tempest-DeleteServersTestJSON-472565240 tempest-DeleteServersTestJSON-472565240-project-member] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 925.017740] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 925.018585] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.018585] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.018585] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.018585] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.018827] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.018827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.018827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.019281] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.022210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.022417] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.182862] env[70006]: INFO networking_nsxv3.common.synchronization [None req-cf09838a-6d11-413d-b911-22babf3b84fb None None] Enqueued Resource ID: f7a0cad1-b212-4a69-9deb-eccecdb30144 with Priority: HIGHEST for action port [ 925.183565] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7a0cad1-b212-4a69-9deb-eccecdb30144 with Priority: HIGHEST for action port [ 925.183865] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7a0cad1-b212-4a69-9deb-eccecdb30144 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.183966] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7a0cad1-b212-4a69-9deb-eccecdb30144" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.184026] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7a0cad1-b212-4a69-9deb-eccecdb30144" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.184611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7a0cad1-b212-4a69-9deb-eccecdb30144" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.186794] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7a0cad1-b212-4a69-9deb-eccecdb30144',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.430517] env[70006]: INFO networking_nsxv3.common.synchronization [req-605659b0-b8ea-4973-920a-686004000c0b req-9aab8991-cf9b-485a-b364-bedf236e7223 tempest-SecurityGroupRulesTestJSON-590804016 tempest-SecurityGroupRulesTestJSON-590804016-project-member] Enqueued Resource ID: 6f6623fa-f3b8-499d-87d5-fb5b45866b93 with Priority: HIGHEST for action security_group_rules [ 925.431235] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6623fa-f3b8-499d-87d5-fb5b45866b93 with Priority: HIGHEST for action security_group_rules [ 925.431560] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f6623fa-f3b8-499d-87d5-fb5b45866b93 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.431737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f6623fa-f3b8-499d-87d5-fb5b45866b93" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.431737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f6623fa-f3b8-499d-87d5-fb5b45866b93" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.432175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f6623fa-f3b8-499d-87d5-fb5b45866b93" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.435630] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f6623fa-f3b8-499d-87d5-fb5b45866b93',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.444581] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.520256] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4596cda-f889-4b1b-8e98-7effb27170e9 in Status: SUCCESS [ 925.520341] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4596cda-f889-4b1b-8e98-7effb27170e9 deletion is rescheduled due to dependency. [ 925.520466] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.525124] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.525301] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.525376] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.525609] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.554399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.554399] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.554399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.554399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.554399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.554399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.554399] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 925.588789] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.589967] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.589967] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.589967] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.589967] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.603689] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 925.691495] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7a0cad1-b212-4a69-9deb-eccecdb30144 [ 925.691835] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.691996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.692167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.692454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.692454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.692721] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7a0cad1-b212-4a69-9deb-eccecdb30144 already deleted. [ 925.692757] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7a0cad1-b212-4a69-9deb-eccecdb30144" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.745461] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.745613] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.745798] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.746318] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.746759] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.747013] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.747250] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.747521] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.747723] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.747974] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.748134] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.748272] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.748452] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.748666] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.748871] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.749115] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.770019] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.770223] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 925.770384] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.770565] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.770873] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-72c3d938-1cba-4e01-8176-aa8e8a245c4c taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.771059] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-72c3d938-1cba-4e01-8176-aa8e8a245c4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.771193] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-72c3d938-1cba-4e01-8176-aa8e8a245c4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.771514] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-72c3d938-1cba-4e01-8176-aa8e8a245c4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.771653] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72c3d938-1cba-4e01-8176-aa8e8a245c4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.844316] env[70006]: INFO networking_nsxv3.common.synchronization [None req-6b2006ee-ca12-4bb6-9968-0cfd1008070c None None] Enqueued Resource ID: cdf25655-cff0-45b8-bc99-581c04cc7ef1 with Priority: HIGHEST for action port [ 925.844316] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf25655-cff0-45b8-bc99-581c04cc7ef1 with Priority: HIGHEST for action port [ 925.844316] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdf25655-cff0-45b8-bc99-581c04cc7ef1 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.844316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdf25655-cff0-45b8-bc99-581c04cc7ef1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.844316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdf25655-cff0-45b8-bc99-581c04cc7ef1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.845245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdf25655-cff0-45b8-bc99-581c04cc7ef1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.845343] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdf25655-cff0-45b8-bc99-581c04cc7ef1',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.952495] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.965027] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.965027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.965027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.965027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.965027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.965027] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f6623fa-f3b8-499d-87d5-fb5b45866b93 already deleted. [ 925.965027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f6623fa-f3b8-499d-87d5-fb5b45866b93" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.273335] env[70006]: INFO networking_nsxv3.common.synchronization [req-6d274207-e109-4395-b718-7f745fc60ec6 req-73f09620-e1a9-42fd-9f53-f2e6db0ea1e1 tempest-SecurityGroupRulesTestJSON-590804016 tempest-SecurityGroupRulesTestJSON-590804016-project-member] Enqueued Resource ID: 8d1a8f4c-3702-43f6-a9bc-9ddb7ae29437 with Priority: HIGHEST for action security_group_rules [ 926.280027] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d1a8f4c-3702-43f6-a9bc-9ddb7ae29437 with Priority: HIGHEST for action security_group_rules [ 926.280027] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.280027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.280027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.280027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.280027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.280027] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 72c3d938-1cba-4e01-8176-aa8e8a245c4c not found, creating... [ 926.280027] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.280027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.280027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.280027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.281103] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.281103] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.282573] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.282920] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.283265] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.285258] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.285542] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 72c3d938-1cba-4e01-8176-aa8e8a245c4c is going to be created. [ 926.289505] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d1a8f4c-3702-43f6-a9bc-9ddb7ae29437 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.289505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d1a8f4c-3702-43f6-a9bc-9ddb7ae29437" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.289505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d1a8f4c-3702-43f6-a9bc-9ddb7ae29437" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.289746] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d1a8f4c-3702-43f6-a9bc-9ddb7ae29437" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.289746] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d1a8f4c-3702-43f6-a9bc-9ddb7ae29437',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.315094] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.315343] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.315477] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.315765] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.316173] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.316265] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-72c3d938-1cba-4e01-8176-aa8e8a245c4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.350440] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdf25655-cff0-45b8-bc99-581c04cc7ef1 [ 926.350440] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.350440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.350440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.350632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.350632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.350694] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdf25655-cff0-45b8-bc99-581c04cc7ef1 already deleted. [ 926.350863] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdf25655-cff0-45b8-bc99-581c04cc7ef1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.457400] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 926.457534] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 926.812680] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.813073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.813160] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.813406] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.813505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.813607] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d1a8f4c-3702-43f6-a9bc-9ddb7ae29437 already deleted. [ 926.813693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d1a8f4c-3702-43f6-a9bc-9ddb7ae29437" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.857058] env[70006]: INFO networking_nsxv3.common.synchronization [req-eb0ef7b3-6475-4698-87d4-c54d0e3ad028 req-99f23796-54f7-42d6-bf0d-93ee77b343bf tempest-SecurityGroupRulesTestJSON-590804016 tempest-SecurityGroupRulesTestJSON-590804016-project-member] Enqueued Resource ID: efefdce9-6997-42c7-a847-1f6395d54c92 with Priority: HIGHEST for action security_group_rules [ 926.858036] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efefdce9-6997-42c7-a847-1f6395d54c92 with Priority: HIGHEST for action security_group_rules [ 926.858353] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efefdce9-6997-42c7-a847-1f6395d54c92 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.858499] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efefdce9-6997-42c7-a847-1f6395d54c92" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.858587] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efefdce9-6997-42c7-a847-1f6395d54c92" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.859063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efefdce9-6997-42c7-a847-1f6395d54c92" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.859143] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efefdce9-6997-42c7-a847-1f6395d54c92',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.278730] env[70006]: INFO networking_nsxv3.common.synchronization [req-52517634-fdf2-494c-8359-52b97cb4080e req-7dee27fa-7c60-49a2-93d6-d33e293d9dd2 service nova] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_rules [ 927.279025] env[70006]: INFO networking_nsxv3.common.synchronization [req-52517634-fdf2-494c-8359-52b97cb4080e req-7dee27fa-7c60-49a2-93d6-d33e293d9dd2 service nova] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 927.279067] env[70006]: INFO networking_nsxv3.common.synchronization [req-52517634-fdf2-494c-8359-52b97cb4080e req-7dee27fa-7c60-49a2-93d6-d33e293d9dd2 service nova] Enqueued Resource ID: 72c3d938-1cba-4e01-8176-aa8e8a245c4c with Priority: HIGHEST for action port [ 927.279669] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_rules [ 927.279712] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 927.279807] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72c3d938-1cba-4e01-8176-aa8e8a245c4c with Priority: HIGHEST for action port [ 927.281638] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.281777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.281821] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.282041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.282157] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.283099] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.283201] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.283332] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-72c3d938-1cba-4e01-8176-aa8e8a245c4c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.283539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72c3d938-1cba-4e01-8176-aa8e8a245c4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.283539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72c3d938-1cba-4e01-8176-aa8e8a245c4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.283668] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72c3d938-1cba-4e01-8176-aa8e8a245c4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.283738] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72c3d938-1cba-4e01-8176-aa8e8a245c4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.371964] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.371964] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.371964] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.371964] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.386120] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 927.387686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.388362] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 927.391202] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.391202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.391417] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.391522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.391657] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.391932] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efefdce9-6997-42c7-a847-1f6395d54c92 already deleted. [ 927.391932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efefdce9-6997-42c7-a847-1f6395d54c92" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.441678] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.441678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.441678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.441678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.449852] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.450446] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 927.450556] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 927.450622] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 927.495270] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.495270] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.495270] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.496041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.496557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.496742] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 927.556272] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.556490] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.556573] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.556849] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.557620] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.558011] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 927.612368] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 927.612368] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 deletion is rescheduled due to dependency. [ 927.612368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.612368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.612368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.612368] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.612729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.612729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.612729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.612910] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.612910] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.622759] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.622967] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.622967] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.625785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.625785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.625785] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:36. [ 927.625785] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7', 'caa33f7e-8d3a-4a22-985b-0a592f9b03a1', '598ac99e-7479-4d78-948d-bd3f771adf65', '05505226-5645-4554-880f-d46c2bac7f8c', 'cd192c2d-795f-4fff-bacc-dc0eb6d345b8', '28b8ed16-99b8-40b6-8095-2254b0cf928c', 'c0b97f55-8a3c-470a-80b7-2654d4b73517', '07080bbd-9bb6-4803-a5af-fb39eb3eee3a', '910c1a22-7c5e-47a2-b5fe-9f886b8ccc98', '41eabc70-5aa4-49e9-9af0-7a72a3eccfca', '6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc', '041bde4c-c513-4b39-85d4-3d543865b6f0', '7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c', 'aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf', '88bcc035-9dc7-4401-b37d-3fe17bc7b0f6', '745088da-b183-4222-8402-76e909adaab2', 'a36672b1-ead4-4521-bd0d-2babb803d619', '4aa62458-e6a1-47ca-9f29-72a54d1dc002', '46e7bb0e-3b0b-455c-8638-3cb59c191bf9', 'd4596cda-f889-4b1b-8e98-7effb27170e9', 'f885e47a-f0d6-416e-9871-7d36cac6dbc6', 'ed4cc3e0-52bb-498d-9f73-56ded2b5d090', '2695bb32-670b-49f4-b84e-274269e20fe5', '7dabf6a4-a7d4-4bc7-a18c-73081fea1de5', 'bcb3911f-9d2b-45be-a214-581dc745aaa9', 'cefeff63-e154-425d-8ffe-56cc092db146', '946a4bb3-35a7-45bf-b93f-0879f8e48ab0', '6d10f346-7e60-4bf9-a322-b64cbffea871', '2d0a478f-3de2-453c-980b-25efdb42c355', 'e45746ed-781c-4f14-807a-e9e8876db03b', '5b2723f9-b1dc-419e-b339-13aae985829f', '8a4e3fb3-c949-45ee-b225-af03d5526168', 'ce0190ac-bf23-4a10-82de-268e3bc82647', 'a703014b-177b-46b0-a1e5-010ba0dfd415', 'b62110f9-4181-4c43-9e99-43fd5dff214d', '6541dc4e-5278-42ae-bed3-8ae1f828bb0f'} {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 927.625785] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 927.644868] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.645074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.645147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.645337] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.645421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.645494] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 927.645626] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 927.645626] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 927.716777] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.716982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.717065] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.717378] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.721154] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.721154] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 927.721154] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 927.721154] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 927.721154] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 927.721154] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/36 resources of Type:Security Group Rules [ 927.721154] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGH for action security_group_rules [ 927.721154] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 with Priority: HIGH for action security_group_rules [ 927.721154] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 598ac99e-7479-4d78-948d-bd3f771adf65 with Priority: HIGH for action security_group_rules [ 927.721154] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 05505226-5645-4554-880f-d46c2bac7f8c with Priority: HIGH for action security_group_rules [ 927.721154] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 with Priority: HIGH for action security_group_rules [ 927.721154] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGH for action security_group_rules [ 927.721154] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 with Priority: HIGH for action security_group_rules [ 927.721761] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a with Priority: HIGH for action security_group_rules [ 927.721761] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGH for action security_group_rules [ 927.721761] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca with Priority: HIGH for action security_group_rules [ 927.721761] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc with Priority: HIGH for action security_group_rules [ 927.721761] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGH for action security_group_rules [ 927.721761] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c with Priority: HIGH for action security_group_rules [ 927.721761] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf with Priority: HIGH for action security_group_rules [ 927.721761] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGH for action security_group_rules [ 927.721761] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGH for action security_group_rules [ 927.722073] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a36672b1-ead4-4521-bd0d-2babb803d619 with Priority: HIGH for action security_group_rules [ 927.722073] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGH for action security_group_rules [ 927.722073] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGH for action security_group_rules [ 927.722073] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4596cda-f889-4b1b-8e98-7effb27170e9 with Priority: HIGH for action security_group_rules [ 927.722073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.785347] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.785482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.786865] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72c3d938-1cba-4e01-8176-aa8e8a245c4c with status ACTIVE [ 927.789068] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.789189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.789232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.789457] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.789548] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.789735] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.789888] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.789888] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.790116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.790116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.790760] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.790760] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.790760] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.790760] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.790760] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.790760] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72c3d938-1cba-4e01-8176-aa8e8a245c4c is going to be updated. [ 927.814193] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.814593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.814720] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.814975] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.815224] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.816102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72c3d938-1cba-4e01-8176-aa8e8a245c4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.918994] env[70006]: INFO networking_nsxv3.common.synchronization [req-a9f98d2c-ff86-459e-b5b0-09a322e77e2b req-d8ba2803-f84e-4074-acf2-93a2f3962135 tempest-AttachVolumeShelveTestJSON-1969238173 tempest-AttachVolumeShelveTestJSON-1969238173-project-member] Enqueued Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_members [ 927.919615] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_members [ 927.919712] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 with Priority: HIGH for action security_group_rules [ 927.919813] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 598ac99e-7479-4d78-948d-bd3f771adf65 with Priority: HIGH for action security_group_rules [ 927.919907] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 with Priority: HIGH for action security_group_rules [ 927.919999] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGH for action security_group_rules [ 927.922705] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4596cda-f889-4b1b-8e98-7effb27170e9 with Priority: HIGH for action security_group_rules [ 927.922705] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGH for action security_group_rules [ 927.922705] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGH for action security_group_rules [ 927.922705] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a36672b1-ead4-4521-bd0d-2babb803d619 with Priority: HIGH for action security_group_rules [ 927.922705] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf with Priority: HIGH for action security_group_rules [ 927.922938] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745088da-b183-4222-8402-76e909adaab2 with Priority: HIGH for action security_group_rules [ 927.922938] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c with Priority: HIGH for action security_group_rules [ 927.923025] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGH for action security_group_rules [ 927.923414] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc with Priority: HIGH for action security_group_rules [ 927.923414] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca with Priority: HIGH for action security_group_rules [ 927.923414] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 with Priority: HIGH for action security_group_rules [ 927.923414] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGH for action security_group_rules [ 927.923660] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a with Priority: HIGH for action security_group_rules [ 927.923660] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 with Priority: HIGH for action security_group_rules [ 927.923761] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 with Priority: HIGH for action security_group_rules [ 927.924081] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05505226-5645-4554-880f-d46c2bac7f8c with Priority: HIGH for action security_group_rules [ 927.924214] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.924460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.924460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.924751] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.924937] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.925092] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.925179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.926749] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.926749] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.926749] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.928222] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.928341] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.928384] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.928552] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.928644] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.929763] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-598ac99e-7479-4d78-948d-bd3f771adf65 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.929866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.929933] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.930134] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.930228] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('598ac99e-7479-4d78-948d-bd3f771adf65',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.931043] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0b97f55-8a3c-470a-80b7-2654d4b73517 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.931150] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.931211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.931647] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.932027] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0b97f55-8a3c-470a-80b7-2654d4b73517',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.934278] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.934400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.934456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.934636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.934703] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.937297] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4596cda-f889-4b1b-8e98-7effb27170e9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.937441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.937511] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.937746] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.937822] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4596cda-f889-4b1b-8e98-7effb27170e9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.938799] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.938911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.938969] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.939183] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.939263] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.940295] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.940415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.940481] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.940639] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.940727] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.942192] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a36672b1-ead4-4521-bd0d-2babb803d619 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.942307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.942405] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.942506] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.942595] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a36672b1-ead4-4521-bd0d-2babb803d619',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.943440] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.943550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.943598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.943808] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.943808] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.944062] env[70006]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 927.944915] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-745088da-b183-4222-8402-76e909adaab2 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.945033] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.945151] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.945305] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.945743] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('745088da-b183-4222-8402-76e909adaab2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.946592] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.946837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.946837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.947939] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.947939] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.948028] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-041bde4c-c513-4b39-85d4-3d543865b6f0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.948084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.949038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.949038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.949038] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.949310] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.949310] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.949408] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.949526] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.949597] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.950636] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41eabc70-5aa4-49e9-9af0-7a72a3eccfca taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.950773] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.950848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.951009] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.951104] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41eabc70-5aa4-49e9-9af0-7a72a3eccfca',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.952380] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.952513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.952566] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.952823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.952823] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('910c1a22-7c5e-47a2-b5fe-9f886b8ccc98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.953682] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.953792] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.953859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.954025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.954102] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.955105] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07080bbd-9bb6-4803-a5af-fb39eb3eee3a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.955218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.955287] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.955506] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.955645] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07080bbd-9bb6-4803-a5af-fb39eb3eee3a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.956582] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd192c2d-795f-4fff-bacc-dc0eb6d345b8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.956705] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.956750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.956902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.956973] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd192c2d-795f-4fff-bacc-dc0eb6d345b8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.958060] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.958060] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.958318] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.958318] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.959107] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('caa33f7e-8d3a-4a22-985b-0a592f9b03a1',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.959588] env[70006]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 927.960693] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05505226-5645-4554-880f-d46c2bac7f8c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.960800] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.960870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.961087] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.961164] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05505226-5645-4554-880f-d46c2bac7f8c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.969765] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.969954] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.969999] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.970242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.970362] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.970537] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.970681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.970681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.970865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.970939] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.971036] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c already deleted. [ 927.971118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.001586] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.001671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.001671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.003217] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.006201] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.006201] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.034776] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.035022] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 598ac99e-7479-4d78-948d-bd3f771adf65 is going to be deleted. [ 928.041220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.041620] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.070586] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.070586] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7 is going to be deleted. [ 928.113802] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.113943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.114039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.114288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.114406] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.114545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-598ac99e-7479-4d78-948d-bd3f771adf65" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.118193] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.120930] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.121200] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.121968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.122288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.122425] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.122576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2c7e4cd-99c2-4a5a-b1c3-f0936b0af0c7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.360789] env[70006]: INFO networking_nsxv3.common.synchronization [None req-f80db0e7-cea4-4d32-8769-5403408b3040 None None] Enqueued Resource ID: f3bc6c11-60f6-4973-bc4a-9139bb860a8f with Priority: HIGHEST for action port [ 928.361573] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3bc6c11-60f6-4973-bc4a-9139bb860a8f with Priority: HIGHEST for action port [ 928.362020] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3bc6c11-60f6-4973-bc4a-9139bb860a8f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.363585] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3bc6c11-60f6-4973-bc4a-9139bb860a8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.363680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3bc6c11-60f6-4973-bc4a-9139bb860a8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.363982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3bc6c11-60f6-4973-bc4a-9139bb860a8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.364106] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3bc6c11-60f6-4973-bc4a-9139bb860a8f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.502422] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.502662] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.502771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.503112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.503376] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.503528] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.503629] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.503868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.504009] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.504172] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.504299] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.516228] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-041bde4c-c513-4b39-85d4-3d543865b6f0 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.516406] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.516520] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.516831] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.517096] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.517257] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.517362] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.517587] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.517717] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.517852] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.517986] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.519479] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.519640] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.519739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.520121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.520250] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.520656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.520656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.520656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.520811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.523992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.523992] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.523992] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.523992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.523992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.523992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.523992] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.523992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.523992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.523992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.523992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.523992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.523992] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.533019] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.533308] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.533362] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.533643] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.533967] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.534156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.534257] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.534493] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.534620] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.534751] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.534883] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.566655] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.566862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.566969] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.567375] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.571694] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.571869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.571961] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.572242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.572463] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.572603] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.572690] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.572909] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.573040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.573169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.573393] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.573566] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.573630] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.573825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.574055] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.574197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.574289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.574495] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.574605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.574722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.574850] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.580432] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.580432] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.580432] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.580432] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.580432] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.580432] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.580432] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.580432] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.580998] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.580998] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.580998] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.580998] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.581211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.581264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.581485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.581691] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.581823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.581911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.582122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.582245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.582360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.582666] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.585298] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.585476] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.585587] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.585832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.586077] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.586231] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.586330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.586552] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.586677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.586812] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.587742] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.587742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.587742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.587742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.587742] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.587990] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.587990] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.588205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.588334] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.588464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.588599] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.592651] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4aa62458-e6a1-47ca-9f29-72a54d1dc002: rpc.has_security_group_logging(os_id): False [ 928.598399] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 041bde4c-c513-4b39-85d4-3d543865b6f0: rpc.has_security_group_logging(os_id): False [ 928.625042] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.651363] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.651626] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.652483] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.652613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.654313] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.654429] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.655668] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.655767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.657792] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.657899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.660107] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.660288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.661083] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.661262] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.661958] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.662060] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.663555] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.663658] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.665889] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.665889] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.668251] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 928.668251] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.668251] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.668740] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 928.669167] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.669263] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.670706] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 928.670706] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.670706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.671538] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 928.671903] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.672062] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4596cda-f889-4b1b-8e98-7effb27170e9 is going to be deleted. [ 928.673455] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.673538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.674997] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.675112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.694221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.694378] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: caa33f7e-8d3a-4a22-985b-0a592f9b03a1 is going to be deleted. [ 928.695424] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.695646] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.719729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.719867] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc is going to be deleted. [ 928.721064] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.721682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.737815] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.737987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.750851] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.750851] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05505226-5645-4554-880f-d46c2bac7f8c is going to be deleted. [ 928.751523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.751825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.753686] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.754275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.789167] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.789295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.792584] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.792735] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0b97f55-8a3c-470a-80b7-2654d4b73517 is going to be deleted. [ 928.794347] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.794347] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.839648] env[70006]: INFO networking_nsxv3.common.synchronization [req-153a7d11-3767-4781-8228-4bf520a76a0c req-88fa3b65-07c7-4ee5-8ac2-ebd83cf6ab15 tempest-SecurityGroupRulesTestJSON-590804016 tempest-SecurityGroupRulesTestJSON-590804016-project-member] Enqueued Resource ID: 529525df-5a67-46dd-9cd2-a8cd054f9c6f with Priority: HIGHEST for action security_group_rules [ 928.840545] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529525df-5a67-46dd-9cd2-a8cd054f9c6f with Priority: HIGHEST for action security_group_rules [ 928.841743] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-529525df-5a67-46dd-9cd2-a8cd054f9c6f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.842218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-529525df-5a67-46dd-9cd2-a8cd054f9c6f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.842331] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-529525df-5a67-46dd-9cd2-a8cd054f9c6f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.843489] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-529525df-5a67-46dd-9cd2-a8cd054f9c6f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.843584] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('529525df-5a67-46dd-9cd2-a8cd054f9c6f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.854037] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.854242] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.854373] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.854694] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.854960] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.856458] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.856458] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.856595] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.856756] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.856973] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.857105] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 928.857214] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 928.857322] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 928.857433] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.857538] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 928.857669] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 928.868917] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3bc6c11-60f6-4973-bc4a-9139bb860a8f [ 928.869170] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.869305] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.869379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.869587] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.869675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.869770] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3bc6c11-60f6-4973-bc4a-9139bb860a8f already deleted. [ 928.869850] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3bc6c11-60f6-4973-bc4a-9139bb860a8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.943240] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 928.944485] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.086 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 928.944485] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 928.944485] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.944485] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-3fc25179-89cf-42de-b6b6-f31806bcbce3 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.944920] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.944920] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.946606] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.946606] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fc25179-89cf-42de-b6b6-f31806bcbce3',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.162101] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.163076] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46e7bb0e-3b0b-455c-8638-3cb59c191bf9: rpc.has_security_group_logging(os_id): False [ 929.164127] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6: rpc.has_security_group_logging(os_id): False [ 929.165480] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.165617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.165736] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.165997] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.165997] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.166139] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 929.167754] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.167909] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.168706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.168827] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf is going to be deleted. [ 929.170266] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.170448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.170448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.170598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.170688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.170945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05505226-5645-4554-880f-d46c2bac7f8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.171696] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.171876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.203885] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.204104] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.204872] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.205020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.223281] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.223439] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41eabc70-5aa4-49e9-9af0-7a72a3eccfca is going to be deleted. [ 929.224445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.224795] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.252928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.253078] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 745088da-b183-4222-8402-76e909adaab2 is going to be deleted. [ 929.254078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.254309] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.277724] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.277978] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.278123] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.278188] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.278398] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.278485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.278724] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.278799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.278840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.278979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.279065] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.279246] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.279327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.279390] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.279530] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.279603] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.279695] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 is going to be updated. [ 929.280837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.281013] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.294311] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.294463] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.294534] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.294782] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.294934] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.318823] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.318952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.319781] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.319876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.320840] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 929.332229] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.332406] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 910c1a22-7c5e-47a2-b5fe-9f886b8ccc98 is going to be deleted. [ 929.333532] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.333696] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.337266] env[70006]: INFO networking_nsxv3.common.synchronization [req-962c5115-a8ba-4fb1-a81e-9a1dd52702fe req-aaba32e8-1627-405d-b2d5-20e1bee0f33f tempest-SecurityGroupRulesTestJSON-590804016 tempest-SecurityGroupRulesTestJSON-590804016-project-member] Enqueued Resource ID: 529525df-5a67-46dd-9cd2-a8cd054f9c6f with Priority: HIGHEST for action security_group_rules [ 929.337540] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529525df-5a67-46dd-9cd2-a8cd054f9c6f with Priority: HIGHEST for action security_group_rules [ 929.338143] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-529525df-5a67-46dd-9cd2-a8cd054f9c6f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.338283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-529525df-5a67-46dd-9cd2-a8cd054f9c6f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.352584] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.352874] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.378284] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.378602] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a36672b1-ead4-4521-bd0d-2babb803d619 is going to be deleted. [ 929.379793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.380870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.403714] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.403714] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.451352] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.451626] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.451800] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.452051] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.452218] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.452382] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 3fc25179-89cf-42de-b6b6-f31806bcbce3 not found, creating... [ 929.452654] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.452812] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.452933] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.453182] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.453325] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.453612] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.453770] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.453892] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.454339] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.454498] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.454647] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 3fc25179-89cf-42de-b6b6-f31806bcbce3 is going to be created. [ 929.486180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.486404] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07080bbd-9bb6-4803-a5af-fb39eb3eee3a is going to be deleted. [ 929.487864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.491706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.491706] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.491706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.515278] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.515278] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.515278] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.516315] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.516429] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.516664] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.518314] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.518679] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.532224] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.532432] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.538274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.538526] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd192c2d-795f-4fff-bacc-dc0eb6d345b8 is going to be deleted. [ 929.539458] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.539699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.539856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.540726] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4596cda-f889-4b1b-8e98-7effb27170e9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.540928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.541126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.541246] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.541366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-caa33f7e-8d3a-4a22-985b-0a592f9b03a1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.542018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.542374] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.542374] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.542575] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6de9f2b4-e2ac-40f6-9bba-0628c26d9ebc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.542678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.542818] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.542884] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.543100] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0b97f55-8a3c-470a-80b7-2654d4b73517" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.543184] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.543309] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.624081] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.624238] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c is going to be deleted. [ 929.626512] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.626512] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.646265] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.648409] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.671722] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28b8ed16-99b8-40b6-8095-2254b0cf928c: rpc.has_security_group_logging(os_id): False [ 929.703040] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.703258] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.715684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.717334] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.717680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.717778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.718054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.718238] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.718545] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.718699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.718773] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.719239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.719239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.719410] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.719410] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.719558] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.719670] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.719824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.719970] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 929.721318] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.722778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.748789] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.749015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.791405] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.791713] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.791843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.791917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.792265] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.792265] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.792409] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.792668] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.792668] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.792784] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.792784] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.793085] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.793255] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.793255] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.793409] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.793490] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.794126] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be updated. [ 929.795619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.795619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.795619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.795619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeaaddd9-b2d7-4b7d-bb7d-934d689cccbf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.795619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.795619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.795619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.795619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41eabc70-5aa4-49e9-9af0-7a72a3eccfca" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.796492] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.796588] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.796648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.796799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.796877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.796995] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ffca7a7-fb64-4bc1-a135-6d8315ed4a8c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.797135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.797330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.797681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.797681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-745088da-b183-4222-8402-76e909adaab2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.797681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.797814] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.797847] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.797938] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 529525df-5a67-46dd-9cd2-a8cd054f9c6f already deleted. [ 929.798028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-529525df-5a67-46dd-9cd2-a8cd054f9c6f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.798748] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.798954] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.799291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.800304] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.800478] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.800562] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.800695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-910c1a22-7c5e-47a2-b5fe-9f886b8ccc98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.800820] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.801834] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.801834] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.801961] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a36672b1-ead4-4521-bd0d-2babb803d619" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.802127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-529525df-5a67-46dd-9cd2-a8cd054f9c6f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.802301] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-529525df-5a67-46dd-9cd2-a8cd054f9c6f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.802400] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('529525df-5a67-46dd-9cd2-a8cd054f9c6f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.803346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.803567] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.803707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.803925] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07080bbd-9bb6-4803-a5af-fb39eb3eee3a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.804471] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.804573] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.804712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.804883] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd192c2d-795f-4fff-bacc-dc0eb6d345b8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.805093] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.805317] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.849851] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.850252] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.850409] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.850463] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.850647] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.850757] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.850854] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 is going to be updated. [ 929.852655] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.852847] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.854439] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: IN_PROGRESS for 2s [ 929.900623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.900971] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.901117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.901186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.901388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.901475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.905028] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c is going to be updated. [ 929.959322] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.959520] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.959559] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.960215] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.960215] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.978907] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.978907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.978907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.978907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.979205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.982640] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 929.991886] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.991886] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.991886] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.991886] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.991886] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.994288] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: IN_PROGRESS for 2s [ 930.011987] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: IN_PROGRESS for 2s [ 930.038864] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 930.039512] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.040164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.040164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.040164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.040164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.078684] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: IN_PROGRESS for 2s [ 930.142097] env[70006]: INFO networking_nsxv3.common.synchronization [req-a9f98d2c-ff86-459e-b5b0-09a322e77e2b req-752e994c-2e5d-4778-96c4-a87bbdcaf7ae service nova] Enqueued Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_rules [ 930.142097] env[70006]: INFO networking_nsxv3.common.synchronization [req-a9f98d2c-ff86-459e-b5b0-09a322e77e2b req-752e994c-2e5d-4778-96c4-a87bbdcaf7ae service nova] Enqueued Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_members [ 930.142097] env[70006]: INFO networking_nsxv3.common.synchronization [req-a9f98d2c-ff86-459e-b5b0-09a322e77e2b req-752e994c-2e5d-4778-96c4-a87bbdcaf7ae service nova] Enqueued Resource ID: 3fc25179-89cf-42de-b6b6-f31806bcbce3 with Priority: HIGHEST for action port [ 930.147069] env[70006]: INFO networking_nsxv3.common.synchronization [req-5a3851b1-0fc8-49ed-aee8-e30d56b45b64 req-340f538a-b4aa-4049-a750-986f077675ef tempest-SecurityGroupRulesTestJSON-590804016 tempest-SecurityGroupRulesTestJSON-590804016-project-member] Enqueued Resource ID: 529525df-5a67-46dd-9cd2-a8cd054f9c6f with Priority: HIGHEST for action security_group_rules [ 930.147069] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_rules [ 930.147069] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fc25179-89cf-42de-b6b6-f31806bcbce3 with Priority: HIGHEST for action port [ 930.147069] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_members [ 930.147069] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529525df-5a67-46dd-9cd2-a8cd054f9c6f with Priority: HIGHEST for action security_group_rules [ 930.147069] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.147069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.147069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.147069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.147069] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.150610] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fc25179-89cf-42de-b6b6-f31806bcbce3 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.150699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.150778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.151175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.151255] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fc25179-89cf-42de-b6b6-f31806bcbce3',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.153271] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.153419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.153506] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.153747] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.153879] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.153992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.154117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.154280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.154365] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.154458] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.155325] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-529525df-5a67-46dd-9cd2-a8cd054f9c6f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.155421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-529525df-5a67-46dd-9cd2-a8cd054f9c6f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.331349] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.331349] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.331535] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.331672] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.331833] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.331905] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 529525df-5a67-46dd-9cd2-a8cd054f9c6f already deleted. [ 930.332097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-529525df-5a67-46dd-9cd2-a8cd054f9c6f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.332173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-529525df-5a67-46dd-9cd2-a8cd054f9c6f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.332376] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-529525df-5a67-46dd-9cd2-a8cd054f9c6f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.332376] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('529525df-5a67-46dd-9cd2-a8cd054f9c6f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.660907] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fc25179-89cf-42de-b6b6-f31806bcbce3 with status ACTIVE [ 930.660907] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.660907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.660907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.660907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.660907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.660907] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.660907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.660907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.660907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.660907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.660907] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.660907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.660907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.660907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.660907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.660907] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fc25179-89cf-42de-b6b6-f31806bcbce3 is going to be updated. [ 930.666465] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.666465] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.666465] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.690374] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.690590] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.690590] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.691518] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.691518] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.691518] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.853028] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.853288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.853288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.853743] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.853743] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.853743] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 529525df-5a67-46dd-9cd2-a8cd054f9c6f already deleted. [ 930.853743] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-529525df-5a67-46dd-9cd2-a8cd054f9c6f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.170645] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.334611] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 931.334785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.334973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.335217] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.335447] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.335522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.335622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.336086] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.336086] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.336086] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.336086] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.673598] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.673870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.673870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.674053] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.674095] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.674168] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c is going to be created. [ 931.701858] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.702083] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.702083] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.702316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.702479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.713056] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c in Status: UNINITIALIZED for 2s [ 931.841359] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.841632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.841632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.841931] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.842149] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.842294] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.842349] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.842585] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.842766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.842881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.843062] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.843170] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.843239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.843415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.843562] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.843643] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.843706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.843854] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.843924] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.844043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.844181] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.878694] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: SUCCESS [ 931.878913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.009137] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 932.009857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.010326] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: SUCCESS [ 932.010530] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.029786] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 932.030037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.093563] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: SUCCESS [ 932.093824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.346931] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5: rpc.has_security_group_logging(os_id): False [ 932.367829] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.368034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.368125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.368416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.388735] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.389086] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.389226] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.389295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.389538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.389650] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.389872] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.389978] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.390085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.390282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.390368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.390557] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.390669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.390730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.390900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.390999] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.391108] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 932.452096] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.452299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.452299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.452551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.452737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.464699] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 932.681274] env[70006]: INFO networking_nsxv3.common.synchronization [req-5ec11ea9-d49a-481b-af9b-cd3ac77f8327 req-8fd38ada-9a3e-4af8-88f0-51940910c108 tempest-ServerDiskConfigTestJSON-1226251677 tempest-ServerDiskConfigTestJSON-1226251677-project-member] Enqueued Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_members [ 932.681856] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_members [ 932.682185] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a51886-1748-4f34-be32-1ba9c09de405 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.682317] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.682388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.682644] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.682789] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.682884] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.682968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.683626] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.683626] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.683626] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.081185] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.081185] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-303" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.081185] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-303" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.082759] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-303" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.083125] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.083305] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.084723] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.084993] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.085175] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.085391] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.085512] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 933.085626] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 933.085737] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 933.085853] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.086009] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 933.086121] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 933.106993] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 933.107199] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 933.107339] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 933.107526] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-303" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.107842] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-f6f11372-627a-4dc6-8fe9-e20fcc0a36ed taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.108030] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-f6f11372-627a-4dc6-8fe9-e20fcc0a36ed" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.108161] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-f6f11372-627a-4dc6-8fe9-e20fcc0a36ed" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.108826] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-f6f11372-627a-4dc6-8fe9-e20fcc0a36ed" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.108826] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6f11372-627a-4dc6-8fe9-e20fcc0a36ed',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.187740] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.187900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.187974] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.188282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.188389] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.188600] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.188693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.188774] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.188945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.189069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.189183] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a51886-1748-4f34-be32-1ba9c09de405 already deleted. [ 933.189308] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.611236] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.611557] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.611644] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.611911] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.612088] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.612252] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port f6f11372-627a-4dc6-8fe9-e20fcc0a36ed not found, creating... [ 933.612533] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.612699] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.612805] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.613060] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.613209] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.613493] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.613653] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.613772] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.613987] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.616224] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.616224] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: f6f11372-627a-4dc6-8fe9-e20fcc0a36ed is going to be created. [ 933.641279] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.641971] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.641971] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.641971] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.642301] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.642684] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-f6f11372-627a-4dc6-8fe9-e20fcc0a36ed" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.729353] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c in Status: SUCCESS [ 933.729700] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.729873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.730143] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.730476] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.730640] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.730733] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.730962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.731945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.732122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.732274] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.238424] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.479030] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 934.479030] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.515228] env[70006]: INFO networking_nsxv3.common.synchronization [req-5ec11ea9-d49a-481b-af9b-cd3ac77f8327 req-59529fb0-8fa0-490a-85c4-70e9d4ab939a service nova] Enqueued Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_rules [ 934.515404] env[70006]: INFO networking_nsxv3.common.synchronization [req-5ec11ea9-d49a-481b-af9b-cd3ac77f8327 req-59529fb0-8fa0-490a-85c4-70e9d4ab939a service nova] Enqueued Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_members [ 934.515610] env[70006]: INFO networking_nsxv3.common.synchronization [req-5ec11ea9-d49a-481b-af9b-cd3ac77f8327 req-59529fb0-8fa0-490a-85c4-70e9d4ab939a service nova] Enqueued Resource ID: f6f11372-627a-4dc6-8fe9-e20fcc0a36ed with Priority: HIGHEST for action port [ 934.516836] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_rules [ 934.516836] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_members [ 934.516836] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f11372-627a-4dc6-8fe9-e20fcc0a36ed with Priority: HIGHEST for action port [ 934.516836] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1a51886-1748-4f34-be32-1ba9c09de405 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.516836] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.516836] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.518096] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.519441] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.519441] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a51886-1748-4f34-be32-1ba9c09de405 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.519441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.519441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.519644] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.519644] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.519708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.519853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.519992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.519992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.520350] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.520983] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6f11372-627a-4dc6-8fe9-e20fcc0a36ed taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.521168] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6f11372-627a-4dc6-8fe9-e20fcc0a36ed" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.521168] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6f11372-627a-4dc6-8fe9-e20fcc0a36ed" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.521415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6f11372-627a-4dc6-8fe9-e20fcc0a36ed" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.521487] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6f11372-627a-4dc6-8fe9-e20fcc0a36ed',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.741400] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f682c5f3-6947-4cf3-a94e-7b777b1efe4c: rpc.has_security_group_logging(os_id): False [ 934.761895] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.762049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.762122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.762398] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.762473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.762834] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.762834] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.762940] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.763020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.763097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.763185] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c is going to be created. [ 934.831638] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.831868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.831954] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.832202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.832474] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.845178] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c in Status: IN_PROGRESS for 2s [ 935.030028] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.030028] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a51886-1748-4f34-be32-1ba9c09de405 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.030028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.030028] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6f11372-627a-4dc6-8fe9-e20fcc0a36ed with status ACTIVE [ 935.032049] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.032049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.032049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.032049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.032049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.032049] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.032049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.032049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.032049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.032049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.032049] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.032049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.034625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.034625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.034625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.034625] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6f11372-627a-4dc6-8fe9-e20fcc0a36ed is going to be updated. [ 935.059741] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.059950] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.060068] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.060502] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.060502] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.060707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6f11372-627a-4dc6-8fe9-e20fcc0a36ed" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.307501] env[70006]: INFO networking_nsxv3.common.synchronization [req-bc08f249-adda-40b2-a374-462dbecadbaa req-9495044e-e33b-40b2-8b0f-8120d93ba391 tempest-ServersTestMultiNic-1235703585 tempest-ServersTestMultiNic-1235703585-project-member] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 935.308103] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 935.309136] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.309136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.309136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.309136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.309136] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.309484] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.309484] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.309484] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.309484] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.309590] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.534936] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.799230] env[70006]: INFO networking_nsxv3.common.synchronization [req-bc08f249-adda-40b2-a374-462dbecadbaa req-24fbdec4-5a85-4aa9-a057-aed6f5084d73 tempest-ServersTestMultiNic-1235703585 tempest-ServersTestMultiNic-1235703585-project-member] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 935.799933] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 935.801101] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.801243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.812366] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.812484] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.813233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.813233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.813233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.813494] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.813494] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.813591] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.813678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.813752] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.813839] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 already deleted. [ 935.813919] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.814083] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.814232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.814369] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.814460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.814636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.814636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.814725] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.814804] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.038630] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.038821] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.038911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.039218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.039343] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.039465] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a51886-1748-4f34-be32-1ba9c09de405 is going to be created. [ 936.066023] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.066023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.066023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.066023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.066023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.077419] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a51886-1748-4f34-be32-1ba9c09de405 in Status: UNINITIALIZED for 2s [ 936.146204] env[70006]: INFO networking_nsxv3.common.synchronization [req-bc08f249-adda-40b2-a374-462dbecadbaa req-0a6fef3e-ec55-42de-be09-be6cc3c7b458 tempest-ServersTestMultiNic-1235703585 tempest-ServersTestMultiNic-1235703585-project-member] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 936.147075] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 936.147357] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.147504] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.259807] env[70006]: INFO networking_nsxv3.common.synchronization [req-3b141172-355e-4acc-ba6d-f413ab7c2de9 req-007590e4-cd26-4bcf-b210-6c8cdc271a60 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: ce0190ac-bf23-4a10-82de-268e3bc82647 with Priority: HIGHEST for action security_group_members [ 936.259974] env[70006]: INFO networking_nsxv3.common.synchronization [req-3b141172-355e-4acc-ba6d-f413ab7c2de9 req-007590e4-cd26-4bcf-b210-6c8cdc271a60 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGHEST for action security_group_members [ 936.260116] env[70006]: INFO networking_nsxv3.common.synchronization [req-3b141172-355e-4acc-ba6d-f413ab7c2de9 req-007590e4-cd26-4bcf-b210-6c8cdc271a60 tempest-SecurityGroupsTestJSON-1428022973 tempest-SecurityGroupsTestJSON-1428022973-project-member] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 936.261534] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce0190ac-bf23-4a10-82de-268e3bc82647 with Priority: HIGHEST for action security_group_members [ 936.261534] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGHEST for action security_group_members [ 936.261534] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGHEST for action security_group_members [ 936.264322] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce0190ac-bf23-4a10-82de-268e3bc82647 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.264457] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.266019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.266019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.266019] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.266019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.266019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.266019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.266019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.266019] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce0190ac-bf23-4a10-82de-268e3bc82647',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.266404] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-041bde4c-c513-4b39-85d4-3d543865b6f0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.266466] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.266835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.266835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.266835] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.266971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.267043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.267189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.267272] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.267378] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.269011] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.269121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.269184] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.269478] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.269635] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.269748] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.269811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.269956] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.270050] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.270142] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.318630] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.318824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.318932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.319137] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.319369] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.323323] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.323494] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.323605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.323868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.324012] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.324122] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 already deleted. [ 936.324213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.324823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.325533] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.325852] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.325852] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.325948] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.326071] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.326186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.326549] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.593587] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-500 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.593916] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-500" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.594149] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-500" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.594617] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-500" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.595045] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.595318] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.595523] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.595863] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.596131] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.596464] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.596681] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 936.596884] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 936.597099] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 936.597308] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.597518] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 936.597770] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 936.617723] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 936.617723] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 936.617723] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 936.617723] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-500" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.618099] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-6114ded0-69f6-4591-bc0f-defc91e44362 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.618337] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-6114ded0-69f6-4591-bc0f-defc91e44362" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.618531] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-6114ded0-69f6-4591-bc0f-defc91e44362" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.618807] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-6114ded0-69f6-4591-bc0f-defc91e44362" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.618953] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6114ded0-69f6-4591-bc0f-defc91e44362',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.770542] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.770711] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.770780] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.771095] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.771129] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.771401] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.771549] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.771649] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.771865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.771968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.772090] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 is going to be updated. [ 936.777944] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.778101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.778101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.778350] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.778459] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.778710] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.778829] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.778897] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.779137] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.779245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.779382] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be updated. [ 936.780874] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.781019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.781089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.781354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.807477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.807797] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.807989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.808151] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.808425] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.808513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.808615] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce0190ac-bf23-4a10-82de-268e3bc82647 is going to be updated. [ 936.815037] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.815037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.815037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.815037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.815037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.818035] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.818207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.818437] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.818698] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.819015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.830173] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.830434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.830521] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.830779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.830915] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.831181] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.831307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.831387] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.831580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.831722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.831768] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 already deleted. [ 936.831858] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.844451] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: IN_PROGRESS for 2s [ 936.845201] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: IN_PROGRESS for 2s [ 936.872863] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c in Status: SUCCESS [ 936.873116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.879063] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.879293] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.879293] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.879543] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.879709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.891059] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce0190ac-bf23-4a10-82de-268e3bc82647 in Status: IN_PROGRESS for 2s [ 937.121746] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.122068] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.122262] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.122647] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.122849] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.123084] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 6114ded0-69f6-4591-bc0f-defc91e44362 not found, creating... [ 937.123477] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.123758] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.123906] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.124392] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.124624] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.125061] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.125290] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.125466] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.125765] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.125981] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.126211] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 6114ded0-69f6-4591-bc0f-defc91e44362 is going to be created. [ 937.147269] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.147559] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.147751] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.148150] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.148480] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.148799] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-6114ded0-69f6-4591-bc0f-defc91e44362" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.862880] env[70006]: INFO networking_nsxv3.common.synchronization [req-bc08f249-adda-40b2-a374-462dbecadbaa req-902289fb-3f1c-4f46-9709-e10271e4511a service nova] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_rules [ 937.863167] env[70006]: INFO networking_nsxv3.common.synchronization [req-bc08f249-adda-40b2-a374-462dbecadbaa req-902289fb-3f1c-4f46-9709-e10271e4511a service nova] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 937.863418] env[70006]: INFO networking_nsxv3.common.synchronization [req-bc08f249-adda-40b2-a374-462dbecadbaa req-902289fb-3f1c-4f46-9709-e10271e4511a service nova] Enqueued Resource ID: 6114ded0-69f6-4591-bc0f-defc91e44362 with Priority: HIGHEST for action port [ 937.864064] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_rules [ 937.864226] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 937.864337] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6114ded0-69f6-4591-bc0f-defc91e44362 with Priority: HIGHEST for action port [ 937.864625] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.864756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.864824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.865617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.865617] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.866602] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.866728] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.866795] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.866962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.867123] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.867230] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.867345] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.867414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.867494] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.867590] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.869718] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-6114ded0-69f6-4591-bc0f-defc91e44362 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.869836] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6114ded0-69f6-4591-bc0f-defc91e44362" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.869905] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6114ded0-69f6-4591-bc0f-defc91e44362" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.870056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6114ded0-69f6-4591-bc0f-defc91e44362" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.870130] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6114ded0-69f6-4591-bc0f-defc91e44362',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.089311] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a51886-1748-4f34-be32-1ba9c09de405 in Status: SUCCESS [ 938.089311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.089311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.089311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.089498] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.089563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.089628] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.089785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.089948] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.089948] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.090645] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.367250] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.367250] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.370639] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.374061] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6114ded0-69f6-4591-bc0f-defc91e44362 with status ACTIVE [ 938.374061] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.374061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.374061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.374061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.374061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.374061] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.374061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.374061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.374061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.374061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.374061] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.374061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.374061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.374061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.375985] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.375985] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6114ded0-69f6-4591-bc0f-defc91e44362 is going to be updated. [ 938.397842] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.399164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.399164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.399164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.399164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.399164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6114ded0-69f6-4591-bc0f-defc91e44362" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.457329] env[70006]: INFO networking_nsxv3.common.synchronization [req-ae2b6fe0-0ac6-4815-af31-2750fd7eb532 req-7f16eb4e-1479-4d0e-8d94-68feeac6c586 tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 with Priority: HIGHEST for action security_group_members [ 938.457805] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 with Priority: HIGHEST for action security_group_members [ 938.458122] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.458286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.458357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.458627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.458781] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.458875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.458935] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.459118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.459424] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.459424] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c6c493-02b2-4cc9-86d0-15e7a48daae4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.592995] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a51886-1748-4f34-be32-1ba9c09de405 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.593216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.593216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.593505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.593602] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.593705] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.593772] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.593913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.594295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.594295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.594295] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a51886-1748-4f34-be32-1ba9c09de405 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.594546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.594546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.594546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.595186] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.595186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.595186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.595186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.595186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.595387] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.595426] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.798497] env[70006]: INFO networking_nsxv3.common.synchronization [None req-c5af15d1-18dc-4e23-bba2-0bcef2978bd2 None None] Enqueued Resource ID: 76825c8e-042a-470a-bf7c-3395f56d1ee9 with Priority: HIGHEST for action port [ 938.799083] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76825c8e-042a-470a-bf7c-3395f56d1ee9 with Priority: HIGHEST for action port [ 938.799521] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-76825c8e-042a-470a-bf7c-3395f56d1ee9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.799665] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76825c8e-042a-470a-bf7c-3395f56d1ee9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.799725] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76825c8e-042a-470a-bf7c-3395f56d1ee9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.800106] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76825c8e-042a-470a-bf7c-3395f56d1ee9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.800292] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76825c8e-042a-470a-bf7c-3395f56d1ee9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.837248] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.837565] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-287" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.837801] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-287" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.839157] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-287" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.839816] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.840048] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.840185] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.840795] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.840795] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.841015] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.841158] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.841344] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.841473] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.841589] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.841701] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.841941] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.859556] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 in Status: SUCCESS [ 938.860652] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 deletion is rescheduled due to dependency. [ 938.860822] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.862545] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 in Status: SUCCESS [ 938.862774] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 deletion is rescheduled due to dependency. [ 938.862920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.867874] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.868070] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 938.868227] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.868718] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-287" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.868909] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-0dd5389a-041f-43b0-949a-78f2655dc2ee taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.869180] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-0dd5389a-041f-43b0-949a-78f2655dc2ee" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.869331] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-0dd5389a-041f-43b0-949a-78f2655dc2ee" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.872323] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-0dd5389a-041f-43b0-949a-78f2655dc2ee" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.872576] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0dd5389a-041f-43b0-949a-78f2655dc2ee',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.873601] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.902121] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce0190ac-bf23-4a10-82de-268e3bc82647 in Status: SUCCESS [ 938.902319] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce0190ac-bf23-4a10-82de-268e3bc82647 deletion is rescheduled due to dependency. [ 938.902453] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.960932] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.961472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.961472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.961593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.961646] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.961888] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.962044] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.962128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.963021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.963021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.963021] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 already deleted. [ 938.963021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.105452] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1a51886-1748-4f34-be32-1ba9c09de405: rpc.has_security_group_logging(os_id): False [ 939.125683] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.125821] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.125889] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.126148] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.126240] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.126428] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.126538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.126588] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.126890] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.126890] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.127028] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.127119] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.127185] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.127331] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.127405] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.127607] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.127694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.127838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.127889] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.127948] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.128047] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1a51886-1748-4f34-be32-1ba9c09de405 is going to be created. [ 939.193825] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.194054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.194100] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.194327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.194543] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.210127] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1a51886-1748-4f34-be32-1ba9c09de405 in Status: IN_PROGRESS for 2s [ 939.304598] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76825c8e-042a-470a-bf7c-3395f56d1ee9 [ 939.304598] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.304598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.304598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.304598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.304813] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.304813] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76825c8e-042a-470a-bf7c-3395f56d1ee9 already deleted. [ 939.304813] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76825c8e-042a-470a-bf7c-3395f56d1ee9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.376518] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.376687] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.376758] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.377106] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.377157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.377237] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be created. [ 939.378787] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.378996] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.383032] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.383032] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.383032] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.383032] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 0dd5389a-041f-43b0-949a-78f2655dc2ee not found, creating... [ 939.383032] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.383032] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.383032] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.383032] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.383032] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.383032] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.383677] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.383677] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.383677] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.383677] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.384181] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 0dd5389a-041f-43b0-949a-78f2655dc2ee is going to be created. [ 939.419055] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.419055] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.419055] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.419055] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.419055] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.419055] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-0dd5389a-041f-43b0-949a-78f2655dc2ee" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.423060] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.423060] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.423060] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.423060] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.423060] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.433890] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: UNINITIALIZED for 2s [ 939.727492] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.727706] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.729891] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.729891] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.730469] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.732724] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.732724] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.732724] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.732724] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.732724] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.732724] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 939.732724] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 939.732724] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 939.733066] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.733066] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 939.733219] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 939.761761] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 939.761761] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 939.761761] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 939.761761] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.762840] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-3e38f8cd-84a0-48be-9215-3dec9c9ced94 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.764370] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-3e38f8cd-84a0-48be-9215-3dec9c9ced94" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.764515] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-3e38f8cd-84a0-48be-9215-3dec9c9ced94" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.764907] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-3e38f8cd-84a0-48be-9215-3dec9c9ced94" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.765080] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e38f8cd-84a0-48be-9215-3dec9c9ced94',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.274022] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.274022] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.274022] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.274022] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.274022] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.274022] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 3e38f8cd-84a0-48be-9215-3dec9c9ced94 not found, creating... [ 940.274022] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.274022] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.274022] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.274022] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.274022] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.274812] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.274992] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.275225] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.275535] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.275756] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.275996] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 3e38f8cd-84a0-48be-9215-3dec9c9ced94 is going to be created. [ 940.311072] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.311646] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.311929] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.312422] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.312997] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.313287] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-3e38f8cd-84a0-48be-9215-3dec9c9ced94" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.355325] env[70006]: INFO networking_nsxv3.common.synchronization [req-bc08f249-adda-40b2-a374-462dbecadbaa req-aaabee41-dc88-4148-8528-1711b0a7cd84 service nova] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_rules [ 940.355325] env[70006]: INFO networking_nsxv3.common.synchronization [req-bc08f249-adda-40b2-a374-462dbecadbaa req-aaabee41-dc88-4148-8528-1711b0a7cd84 service nova] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 940.355325] env[70006]: INFO networking_nsxv3.common.synchronization [req-bc08f249-adda-40b2-a374-462dbecadbaa req-aaabee41-dc88-4148-8528-1711b0a7cd84 service nova] Enqueued Resource ID: 0dd5389a-041f-43b0-949a-78f2655dc2ee with Priority: HIGHEST for action port [ 940.355587] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_rules [ 940.355764] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 940.355898] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd5389a-041f-43b0-949a-78f2655dc2ee with Priority: HIGHEST for action port [ 940.360592] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.360592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.360715] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.360753] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.360937] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-0dd5389a-041f-43b0-949a-78f2655dc2ee taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.361052] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0dd5389a-041f-43b0-949a-78f2655dc2ee" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.361119] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0dd5389a-041f-43b0-949a-78f2655dc2ee" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.361363] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0dd5389a-041f-43b0-949a-78f2655dc2ee" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.361454] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0dd5389a-041f-43b0-949a-78f2655dc2ee',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.870107] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0dd5389a-041f-43b0-949a-78f2655dc2ee with status ACTIVE [ 940.870308] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.870422] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.870492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.870707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.870823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.870960] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.871068] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.871130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.871283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.871363] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.871802] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.871989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.871989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.872491] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.872491] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.872491] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0dd5389a-041f-43b0-949a-78f2655dc2ee is going to be updated. [ 940.903135] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.903790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.903790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.903790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.903790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.903946] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0dd5389a-041f-43b0-949a-78f2655dc2ee" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.238832] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1a51886-1748-4f34-be32-1ba9c09de405 in Status: SUCCESS [ 941.239238] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.308405] env[70006]: INFO networking_nsxv3.common.synchronization [req-ae2b6fe0-0ac6-4815-af31-2750fd7eb532 req-895ffca9-43da-412b-9b2c-a199ca66b1fe service nova] Enqueued Resource ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 with Priority: HIGHEST for action security_group_rules [ 941.308741] env[70006]: INFO networking_nsxv3.common.synchronization [req-ae2b6fe0-0ac6-4815-af31-2750fd7eb532 req-895ffca9-43da-412b-9b2c-a199ca66b1fe service nova] Enqueued Resource ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 with Priority: HIGHEST for action security_group_members [ 941.308851] env[70006]: INFO networking_nsxv3.common.synchronization [req-ae2b6fe0-0ac6-4815-af31-2750fd7eb532 req-895ffca9-43da-412b-9b2c-a199ca66b1fe service nova] Enqueued Resource ID: 3e38f8cd-84a0-48be-9215-3dec9c9ced94 with Priority: HIGHEST for action port [ 941.309813] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 with Priority: HIGHEST for action security_group_rules [ 941.310024] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 with Priority: HIGHEST for action security_group_members [ 941.310135] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e38f8cd-84a0-48be-9215-3dec9c9ced94 with Priority: HIGHEST for action port [ 941.310530] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.310671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.310721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.310937] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.311029] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3c6c493-02b2-4cc9-86d0-15e7a48daae4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.312491] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.312885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.312885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.312981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.313504] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.313504] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.313504] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.313504] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.313722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.313722] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c6c493-02b2-4cc9-86d0-15e7a48daae4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.314735] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e38f8cd-84a0-48be-9215-3dec9c9ced94 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.314735] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e38f8cd-84a0-48be-9215-3dec9c9ced94" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.314735] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e38f8cd-84a0-48be-9215-3dec9c9ced94" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.314928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e38f8cd-84a0-48be-9215-3dec9c9ced94" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.315034] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e38f8cd-84a0-48be-9215-3dec9c9ced94',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.429150] env[70006]: INFO networking_nsxv3.common.synchronization [None req-1d9441a9-efd8-45d6-a0df-900c6254cae5 None None] Enqueued Resource ID: 90cf3b39-c6e9-4827-8de9-fbd3f3383432 with Priority: HIGHEST for action port [ 941.429683] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90cf3b39-c6e9-4827-8de9-fbd3f3383432 with Priority: HIGHEST for action port [ 941.429986] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-90cf3b39-c6e9-4827-8de9-fbd3f3383432 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.430114] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90cf3b39-c6e9-4827-8de9-fbd3f3383432" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.430178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90cf3b39-c6e9-4827-8de9-fbd3f3383432" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.432087] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90cf3b39-c6e9-4827-8de9-fbd3f3383432" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.432217] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90cf3b39-c6e9-4827-8de9-fbd3f3383432',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.444997] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 941.445268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.445446] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.445671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.445879] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.446132] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.446132] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.446262] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.446340] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.446438] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.446541] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.448792] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.449024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.449246] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.449857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.449857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.449857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.449857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.449857] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.568706] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-500 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.569105] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-500" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.569393] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-500" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.569818] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-500" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.570300] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.570622] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.570881] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.571239] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.571568] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.571889] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.572126] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.572351] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.572545] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.572777] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.572986] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.573249] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.600487] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.600487] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 941.600487] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.600487] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-500" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.600487] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.600487] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.600487] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.601671] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.601671] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.817148] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3c6c493-02b2-4cc9-86d0-15e7a48daae4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.818560] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.818693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.819060] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e38f8cd-84a0-48be-9215-3dec9c9ced94 with status ACTIVE [ 941.819221] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.819335] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.819441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.819602] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.819689] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.819852] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.819942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.820027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.821246] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.821453] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.821801] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.821968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.822048] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.822213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.822290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.822418] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e38f8cd-84a0-48be-9215-3dec9c9ced94 is going to be updated. [ 941.848453] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.848699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.848759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.849600] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.849600] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.850489] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e38f8cd-84a0-48be-9215-3dec9c9ced94" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.935078] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90cf3b39-c6e9-4827-8de9-fbd3f3383432 [ 941.935078] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.936210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.936210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.936465] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.936637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.936791] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90cf3b39-c6e9-4827-8de9-fbd3f3383432 already deleted. [ 941.936921] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90cf3b39-c6e9-4827-8de9-fbd3f3383432" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.952316] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.954230] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.954648] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.104217] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.104460] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.104598] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.104900] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.105055] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.105212] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a not found, creating... [ 942.105469] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.105625] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.105750] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.108723] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.108723] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.108948] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.109066] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.109193] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.109505] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.109681] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.109809] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a is going to be created. [ 942.135045] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.135246] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.135386] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.135708] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.139112] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.139112] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.319487] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3c6c493-02b2-4cc9-86d0-15e7a48daae4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.457597] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.822170] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.822617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.823511] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.823876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.825207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.825207] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 is going to be created. [ 942.867291] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.867443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.867515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.867735] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.867940] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.878397] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 in Status: UNINITIALIZED for 2s [ 942.960873] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.960873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.960873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.961052] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.961052] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.961123] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be updated. [ 942.990740] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.990918] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.990949] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.991167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.991294] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.000970] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 943.015022] env[70006]: INFO networking_nsxv3.common.synchronization [req-bc08f249-adda-40b2-a374-462dbecadbaa req-2d76cefb-4eec-4b2e-82a2-d8f236f0427f service nova] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_rules [ 943.015022] env[70006]: INFO networking_nsxv3.common.synchronization [req-bc08f249-adda-40b2-a374-462dbecadbaa req-2d76cefb-4eec-4b2e-82a2-d8f236f0427f service nova] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 943.015022] env[70006]: INFO networking_nsxv3.common.synchronization [req-bc08f249-adda-40b2-a374-462dbecadbaa req-2d76cefb-4eec-4b2e-82a2-d8f236f0427f service nova] Enqueued Resource ID: 894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a with Priority: HIGHEST for action port [ 943.015022] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_rules [ 943.015022] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 943.015672] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a with Priority: HIGHEST for action port [ 943.016152] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.016364] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.017197] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.018747] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.018747] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.018747] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.018747] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.018747] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.018747] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.521253] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a with status ACTIVE [ 943.521620] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.521790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.521875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.522167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.522295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.522702] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.522833] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.522911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.523140] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.523243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.523479] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.523611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.523677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.523871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.523962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.524153] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a is going to be updated. [ 943.552729] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.552911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.552996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.553282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.553446] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.553650] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-894fb3a3-f1d1-438f-abc0-6fa78a9e8b4a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.895146] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 in Status: SUCCESS [ 944.895146] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.895528] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.895778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.896000] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.896133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.896216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.896380] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.896479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.896861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.897872] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3c6c493-02b2-4cc9-86d0-15e7a48daae4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.015194] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 945.015194] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.015194] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.015439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.016371] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.016371] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.016371] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.016371] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.016371] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.016371] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.016624] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.016624] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.016624] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.017686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.017686] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.017686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.017686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.017686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.017686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.018385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.018490] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.019602] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.019788] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.019957] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.020160] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.020160] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.020413] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.020512] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.020606] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.401440] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3c6c493-02b2-4cc9-86d0-15e7a48daae4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.527465] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5bdfda1-5bdc-410b-ab38-e2b0315faa59: rpc.has_security_group_logging(os_id): False [ 945.528748] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.549577] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.549577] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.549577] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.549794] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.549888] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.550083] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.550192] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.550264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.550448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.550540] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.550741] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.550846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.550895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.551058] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.551131] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.551329] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.551431] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.551491] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.551642] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.551719] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.551808] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be created. [ 945.623608] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.623786] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.623861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.624099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.624323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.636874] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 945.903585] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3c6c493-02b2-4cc9-86d0-15e7a48daae4: rpc.has_security_group_logging(os_id): False [ 945.926180] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.926180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.926180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.926180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.926180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.926180] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.926180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.926180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.926180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.926180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.926180] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 is going to be created. [ 945.994335] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.994579] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.994665] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.994859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.995101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.004974] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 in Status: IN_PROGRESS for 2s [ 946.035870] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.543897] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.543897] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.543897] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.543897] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.543897] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.543897] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be updated. [ 946.578655] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.578655] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.578655] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.578655] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.578655] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.590757] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 947.612983] env[70006]: INFO networking_nsxv3.common.synchronization [req-eb4feab0-90e6-476d-ab4f-499ef9b50755 req-e3cfa43a-3567-4ec9-b359-a71ef01a8e8a tempest-ServerRescueTestJSONUnderV235-1723903125 tempest-ServerRescueTestJSONUnderV235-1723903125-project-member] Enqueued Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_members [ 947.613581] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_members [ 947.614163] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.614163] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.614326] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.614598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.614935] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.614935] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.615099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.615256] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.615389] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.615553] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.653272] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 947.653523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.654065] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.654292] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.654378] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.021224] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 in Status: SUCCESS [ 948.021224] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.118940] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.118940] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.118940] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.118940] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.119222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.119273] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.119682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.119682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.120288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.120288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.120288] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbe1012c-c0e9-492c-808f-64ce71e77277 already deleted. [ 948.120288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.158572] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.159079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.160677] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-235 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.160892] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-235" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.161032] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-235" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.161415] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-235" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.161698] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.161894] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.162033] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.162273] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.162430] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.162651] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.162771] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.162897] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.163098] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.163238] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.163365] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.163504] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.188871] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.189204] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 948.189204] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.189546] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-235" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.190144] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-7beab378-23cf-4f47-8004-b917e0a1e482 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.190144] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.190144] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.190931] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.191071] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7beab378-23cf-4f47-8004-b917e0a1e482',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.604357] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 948.604770] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.605050] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.605325] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.605873] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.605873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.605873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.606074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.606211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.606286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.606489] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.696026] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.696026] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.696026] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.696026] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.696026] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.696026] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 7beab378-23cf-4f47-8004-b917e0a1e482 not found, creating... [ 948.696026] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.696026] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.696026] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.696026] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.696026] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.696708] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.697218] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.697565] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.697921] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.698336] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.698747] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 7beab378-23cf-4f47-8004-b917e0a1e482 is going to be created. [ 948.725111] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.725111] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.725437] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.726093] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.726533] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.726960] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.109204] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.109452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.109503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.109726] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.109901] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.110009] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.110073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.110225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.110314] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.110476] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.110628] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.110721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.110782] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.110960] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.111122] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.111214] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.111274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.111473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.111584] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.111671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.111758] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.410134] env[70006]: INFO networking_nsxv3.common.synchronization [req-eb4feab0-90e6-476d-ab4f-499ef9b50755 req-8e76a864-63f5-43a8-86f7-455ecf35e54d service nova] Enqueued Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_rules [ 949.410966] env[70006]: INFO networking_nsxv3.common.synchronization [req-eb4feab0-90e6-476d-ab4f-499ef9b50755 req-8e76a864-63f5-43a8-86f7-455ecf35e54d service nova] Enqueued Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_members [ 949.410966] env[70006]: INFO networking_nsxv3.common.synchronization [req-eb4feab0-90e6-476d-ab4f-499ef9b50755 req-8e76a864-63f5-43a8-86f7-455ecf35e54d service nova] Enqueued Resource ID: 7beab378-23cf-4f47-8004-b917e0a1e482 with Priority: HIGHEST for action port [ 949.410966] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_rules [ 949.410966] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_members [ 949.410966] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7beab378-23cf-4f47-8004-b917e0a1e482 with Priority: HIGHEST for action port [ 949.411721] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.413225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.413498] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.413689] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.413784] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.414837] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.414980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.415062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.415724] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.415900] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.415992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.416070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.416215] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.416304] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.416398] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.417298] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-7beab378-23cf-4f47-8004-b917e0a1e482 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.418357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.418357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.418357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.418357] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7beab378-23cf-4f47-8004-b917e0a1e482',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.614352] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5bdfda1-5bdc-410b-ab38-e2b0315faa59: rpc.has_security_group_logging(os_id): False [ 949.634095] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.634260] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.634339] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.634561] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.634659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.634877] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.634976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.635052] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.635208] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.635285] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.635477] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.635599] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.635667] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.635831] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.635909] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.637042] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.637296] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.637914] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.638143] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.639076] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.639232] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be updated. [ 949.708252] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.708252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.708252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.708759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.708967] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.722346] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 949.919874] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.920039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.920258] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.921293] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7beab378-23cf-4f47-8004-b917e0a1e482 with status ACTIVE [ 949.921522] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.921642] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.921709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.921923] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.922557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.922557] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.922557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.922557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.922557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.922557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.922863] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.922863] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.922932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.923104] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.923167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.923212] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7beab378-23cf-4f47-8004-b917e0a1e482 is going to be updated. [ 949.945250] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.945468] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.945588] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.945830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.946012] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.946262] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.426905] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.928581] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.929097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.929097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.929242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.929358] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.929489] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbe1012c-c0e9-492c-808f-64ce71e77277 is going to be created. [ 950.956389] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.956565] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.956629] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.956825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.956980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.969592] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: UNINITIALIZED for 2s [ 951.738204] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 951.738934] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.739261] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.739685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.739685] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.242386] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.242732] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.242732] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.242916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.243316] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.243410] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.243468] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.243688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.243835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.243997] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.244192] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.746987] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.747181] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.747249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.747480] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.747655] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.747755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.747822] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.748025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.748106] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.748161] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.748490] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.748605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.748668] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.748819] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.749102] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.749102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.749217] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.749259] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.749336] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.749420] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.749513] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.984154] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: SUCCESS [ 952.984154] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.984154] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.984154] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.984154] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.984154] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.984154] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.984154] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.984154] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.984154] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.984154] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.254237] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5bdfda1-5bdc-410b-ab38-e2b0315faa59: rpc.has_security_group_logging(os_id): False [ 953.279210] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.279210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.279210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.279210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.279210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.279210] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.279210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.279210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.279210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.279210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.279210] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.279210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.279210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.279210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.279210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.279943] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.279943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.279943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.279943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.279943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.279943] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be updated. [ 953.353068] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.353236] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.353312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.353537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.353694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.375899] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 953.489421] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.489421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.489421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.489421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.489421] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.489421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.489761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.489761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.489761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.489883] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.489922] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.490150] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.490150] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.490276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.490500] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.490500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.490655] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.490704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.490775] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.490852] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.490937] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.997406] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbe1012c-c0e9-492c-808f-64ce71e77277: rpc.has_security_group_logging(os_id): False [ 954.017028] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.017028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.017028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.017028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.017028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.017614] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.017614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.017614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.017614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.017614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.017844] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.017844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.017844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.017971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.018296] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.018478] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.018573] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.018632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.018826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.018873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.018921] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbe1012c-c0e9-492c-808f-64ce71e77277 is going to be created. [ 954.083422] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.083422] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.083422] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.083422] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.083422] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.095854] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: IN_PROGRESS for 2s [ 954.411722] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 954.412011] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 955.394962] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 955.395435] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.112474] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: SUCCESS [ 956.112845] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.037695] env[70006]: INFO networking_nsxv3.common.synchronization [None req-635dfe7d-dd28-4756-9d31-17e5fd4f639c None None] Enqueued Resource ID: 58177585-61a0-4621-9bc3-6861d5eea61b with Priority: HIGHEST for action port [ 957.038410] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58177585-61a0-4621-9bc3-6861d5eea61b with Priority: HIGHEST for action port [ 957.038880] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-58177585-61a0-4621-9bc3-6861d5eea61b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.038880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58177585-61a0-4621-9bc3-6861d5eea61b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.038880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58177585-61a0-4621-9bc3-6861d5eea61b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.039194] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58177585-61a0-4621-9bc3-6861d5eea61b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.039280] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58177585-61a0-4621-9bc3-6861d5eea61b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.295161] env[70006]: INFO networking_nsxv3.common.synchronization [req-7e22046a-0628-4a09-9720-edfadf6a3427 req-d5c5a4bd-1e59-4707-a29d-5488055101ed tempest-ServersTestMultiNic-1235703585 tempest-ServersTestMultiNic-1235703585-project-member] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 957.295762] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 957.296460] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.296609] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.296680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.296893] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.297124] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.297275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.297337] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.297519] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.297632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.297777] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.543094] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58177585-61a0-4621-9bc3-6861d5eea61b [ 957.543094] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.543094] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.543094] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.543094] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.543094] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.543094] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58177585-61a0-4621-9bc3-6861d5eea61b already deleted. [ 957.543094] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58177585-61a0-4621-9bc3-6861d5eea61b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.764325] env[70006]: INFO networking_nsxv3.common.synchronization [req-7e22046a-0628-4a09-9720-edfadf6a3427 req-950393ce-7204-4c7f-8221-480119a5bcbe tempest-ServersTestMultiNic-1235703585 tempest-ServersTestMultiNic-1235703585-project-member] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 957.764325] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 957.764325] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.764789] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.801106] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.802361] env[70006]: INFO networking_nsxv3.common.synchronization [None req-887b14f2-c2a1-47b5-9fd5-b5b6e76453b1 tempest-AttachVolumeNegativeTest-242855104 tempest-AttachVolumeNegativeTest-242855104-project-member] Enqueued Resource ID: f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f with Priority: HIGHEST for action security_group_rules [ 957.805075] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f with Priority: HIGHEST for action security_group_rules [ 957.805075] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.805075] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.805075] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.805412] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.805412] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.918530] env[70006]: INFO networking_nsxv3.common.synchronization [None req-de1079e1-bf95-493a-810a-cfb4925cd0ff tempest-AttachVolumeNegativeTest-242855104 tempest-AttachVolumeNegativeTest-242855104-project-member] Enqueued Resource ID: f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f with Priority: HIGHEST for action security_group_rules [ 957.919190] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f with Priority: HIGHEST for action security_group_rules [ 957.919388] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.919489] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.008051] env[70006]: INFO networking_nsxv3.common.synchronization [req-0013a290-56f6-4381-a769-acaf8844d4d9 req-ff93548c-eae5-44f3-8f43-20bec952fd44 tempest-ServerDiskConfigTestJSON-1226251677 tempest-ServerDiskConfigTestJSON-1226251677-project-member] Enqueued Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_members [ 958.008966] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_members [ 958.008966] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a51886-1748-4f34-be32-1ba9c09de405 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.009118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.009247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.009465] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.009626] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.009731] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.009791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.010541] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.010541] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.010541] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.305212] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.310098] env[70006]: INFO networking_nsxv3.common.synchronization [req-7e22046a-0628-4a09-9720-edfadf6a3427 req-5c12377c-1d82-4e8a-9717-23d0c0b8f23d tempest-ServersTestMultiNic-1235703585 tempest-ServersTestMultiNic-1235703585-project-member] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 958.310855] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 958.311762] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.312054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.332346] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.332346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.332346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.332346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.332346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.332346] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f already deleted. [ 958.332346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.332346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.332346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.332346] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.513282] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.513470] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.513573] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.513840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.513947] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.514650] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.514650] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.514650] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.514803] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.514803] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.514903] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a51886-1748-4f34-be32-1ba9c09de405 is going to be updated. [ 958.544601] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.544761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.544837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.546130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.546130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.556600] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a51886-1748-4f34-be32-1ba9c09de405 in Status: IN_PROGRESS for 2s [ 958.807038] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.807272] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.807331] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.807525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.807617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.807720] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be updated. [ 958.834280] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.834485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.834528] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.834947] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.835163] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.846483] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 958.854623] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.854783] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.854845] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.855098] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.855190] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.855287] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f already deleted. [ 958.855369] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1a91d34-5495-4bc2-8eb9-3412bf8e4d8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.965035] env[70006]: INFO networking_nsxv3.common.synchronization [None req-2658bb0e-c38f-4611-b818-d3f64cf2c7a0 None None] Enqueued Resource ID: 3e347f2f-0d0a-4ed2-a0e1-814fbec1fdf3 with Priority: HIGHEST for action port [ 958.965601] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e347f2f-0d0a-4ed2-a0e1-814fbec1fdf3 with Priority: HIGHEST for action port [ 958.965918] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e347f2f-0d0a-4ed2-a0e1-814fbec1fdf3 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.966215] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e347f2f-0d0a-4ed2-a0e1-814fbec1fdf3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.966302] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e347f2f-0d0a-4ed2-a0e1-814fbec1fdf3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.966556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e347f2f-0d0a-4ed2-a0e1-814fbec1fdf3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.966653] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e347f2f-0d0a-4ed2-a0e1-814fbec1fdf3',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.473443] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e347f2f-0d0a-4ed2-a0e1-814fbec1fdf3 [ 959.473900] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.473900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.473900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.474144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.474235] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.474331] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e347f2f-0d0a-4ed2-a0e1-814fbec1fdf3 already deleted. [ 959.474409] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e347f2f-0d0a-4ed2-a0e1-814fbec1fdf3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.419513] env[70006]: INFO networking_nsxv3.common.synchronization [req-e9b30ee6-f7a3-4f6e-b086-f74337a2953c req-f90b47d1-9893-4797-99dd-c459cbed3d00 tempest-ImagesTestJSON-196229908 tempest-ImagesTestJSON-196229908-project-member] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 960.420130] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 960.420463] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.420600] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.420668] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.420938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.421151] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.421261] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.421351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.421581] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.421663] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.421784] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.567630] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a51886-1748-4f34-be32-1ba9c09de405 in Status: SUCCESS [ 960.567984] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a51886-1748-4f34-be32-1ba9c09de405 deletion is rescheduled due to dependency. [ 960.567984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.807327] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.807327] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.807327] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.807327] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.807327] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.807327] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.807327] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.807327] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.807327] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.807327] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.807327] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.807327] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.807327] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.807717] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.807717] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.807717] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.826043] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.826238] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 960.826385] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.826568] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-483" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.826890] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-4edd213b-3ed8-4731-8128-4caf383b2277 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.827086] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-4edd213b-3ed8-4731-8128-4caf383b2277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.827216] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-4edd213b-3ed8-4731-8128-4caf383b2277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.827555] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-4edd213b-3ed8-4731-8128-4caf383b2277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.828608] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4edd213b-3ed8-4731-8128-4caf383b2277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.858054] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 960.858054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.858054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.858054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.858054] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.858290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.858290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.858395] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.858502] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.858604] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.924584] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.333360] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.333552] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.333651] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.333951] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.334139] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.334298] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 4edd213b-3ed8-4731-8128-4caf383b2277 not found, creating... [ 961.334569] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.334731] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.334854] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.335101] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.335247] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.335728] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.335728] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.336155] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.336155] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.336328] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.336328] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 4edd213b-3ed8-4731-8128-4caf383b2277 is going to be created. [ 961.362096] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.362353] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.362494] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.362831] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.363140] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.363382] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-4edd213b-3ed8-4731-8128-4caf383b2277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.364533] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.364533] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.364533] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.364694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.364829] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.364956] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.365078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.365149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.365295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.365370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.365454] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be updated. [ 961.392947] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.393033] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.393064] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.393275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.393418] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.407129] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 961.426458] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.934477] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.934477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.934477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.934477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.934477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.934477] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be updated. [ 961.973648] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.973812] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.973812] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.974091] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.974178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.984664] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: IN_PROGRESS for 2s [ 962.080027] env[70006]: INFO networking_nsxv3.common.synchronization [req-e9b30ee6-f7a3-4f6e-b086-f74337a2953c req-2924c10f-7bb0-46ed-986b-f98f0a864dd6 service nova] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_rules [ 962.080027] env[70006]: INFO networking_nsxv3.common.synchronization [req-e9b30ee6-f7a3-4f6e-b086-f74337a2953c req-2924c10f-7bb0-46ed-986b-f98f0a864dd6 service nova] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 962.080027] env[70006]: INFO networking_nsxv3.common.synchronization [req-e9b30ee6-f7a3-4f6e-b086-f74337a2953c req-2924c10f-7bb0-46ed-986b-f98f0a864dd6 service nova] Enqueued Resource ID: 4edd213b-3ed8-4731-8128-4caf383b2277 with Priority: HIGHEST for action port [ 962.080027] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_rules [ 962.080027] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 962.080816] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4edd213b-3ed8-4731-8128-4caf383b2277 with Priority: HIGHEST for action port [ 962.081454] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.081797] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.082019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.082509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.082747] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.084270] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.084270] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.084466] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-4edd213b-3ed8-4731-8128-4caf383b2277 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.084608] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4edd213b-3ed8-4731-8128-4caf383b2277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.084774] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4edd213b-3ed8-4731-8128-4caf383b2277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.084931] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4edd213b-3ed8-4731-8128-4caf383b2277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.085097] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4edd213b-3ed8-4731-8128-4caf383b2277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.587400] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4edd213b-3ed8-4731-8128-4caf383b2277 with status ACTIVE [ 962.587675] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.587781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.587854] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.588097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.588214] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.588400] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.588508] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.588551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.588699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.588775] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.588953] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.589058] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.589119] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.589260] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.589333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.589417] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4edd213b-3ed8-4731-8128-4caf383b2277 is going to be updated. [ 962.590629] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.590750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.612883] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.613030] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.613103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.613317] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.613454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.613654] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4edd213b-3ed8-4731-8128-4caf383b2277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.418220] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 963.418540] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 deletion is rescheduled due to dependency. [ 963.418540] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.418664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.418900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.419104] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.419224] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.419290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.419445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.420051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.420051] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.922731] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.923059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.923158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.923430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.923598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.923775] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.923904] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.923968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.924172] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.924245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.924362] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be updated. [ 963.954023] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.954210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.954299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.954549] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.954719] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.965933] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 963.999904] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 964.000163] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.000363] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.000782] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.000993] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.001147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.001220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.001585] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.001737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.001856] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.504403] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.006789] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.064850] env[70006]: INFO networking_nsxv3.common.synchronization [req-947ee1d2-e696-4882-be53-9e6dea76a214 req-18fad2a6-56ac-4650-bc4f-16c3ea97550a tempest-ServerRescueNegativeTestJSON-1434609939 tempest-ServerRescueNegativeTestJSON-1434609939-project-member] Enqueued Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_members [ 965.065446] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_members [ 965.065799] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.065945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.066348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.066348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.066505] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.066569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.066569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.066755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.066853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.066950] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.509972] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.510479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.510479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.510479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.510631] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.510688] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be updated. [ 965.561829] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.561993] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.562085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.562304] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.562458] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.569285] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.574380] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: IN_PROGRESS for 2s [ 965.976239] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 965.976528] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 deletion is rescheduled due to dependency. [ 965.976697] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.071347] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.575549] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.575875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.575875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.576215] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.576360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.576743] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 is going to be updated. [ 966.608880] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.608880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.608880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.608880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.609236] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.618387] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: IN_PROGRESS for 2s [ 967.139868] env[70006]: INFO networking_nsxv3.common.synchronization [req-ccd8fda7-d438-49a3-8d1d-e6a03c5469aa req-77a1a9e2-0466-46fd-b3bf-9a333436795d tempest-ServerRescueTestJSONUnderV235-1723903125 tempest-ServerRescueTestJSONUnderV235-1723903125-project-member] Enqueued Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_members [ 967.140883] env[70006]: INFO networking_nsxv3.common.synchronization [req-ccd8fda7-d438-49a3-8d1d-e6a03c5469aa req-77a1a9e2-0466-46fd-b3bf-9a333436795d tempest-ServerRescueTestJSONUnderV235-1723903125 tempest-ServerRescueTestJSONUnderV235-1723903125-project-member] Enqueued Resource ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 with Priority: HIGHEST for action security_group_members [ 967.140883] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_members [ 967.140883] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 with Priority: HIGHEST for action security_group_members [ 967.141450] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.141450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.141623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.141722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.141884] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.141982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.142080] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.142271] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.142353] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.142443] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.144268] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.144389] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.144462] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.144912] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.145084] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.145184] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.145249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.145479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.145576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.145669] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdf7a3d7-d87d-4373-8fa5-c254d3dba846',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.193930] env[70006]: INFO networking_nsxv3.common.synchronization [req-ccd8fda7-d438-49a3-8d1d-e6a03c5469aa req-77a1a9e2-0466-46fd-b3bf-9a333436795d tempest-ServerRescueTestJSONUnderV235-1723903125 tempest-ServerRescueTestJSONUnderV235-1723903125-project-member] Enqueued Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_rules [ 967.194130] env[70006]: INFO networking_nsxv3.common.synchronization [req-ccd8fda7-d438-49a3-8d1d-e6a03c5469aa req-77a1a9e2-0466-46fd-b3bf-9a333436795d tempest-ServerRescueTestJSONUnderV235-1723903125 tempest-ServerRescueTestJSONUnderV235-1723903125-project-member] Enqueued Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_members [ 967.194282] env[70006]: INFO networking_nsxv3.common.synchronization [req-ccd8fda7-d438-49a3-8d1d-e6a03c5469aa req-77a1a9e2-0466-46fd-b3bf-9a333436795d tempest-ServerRescueTestJSONUnderV235-1723903125 tempest-ServerRescueTestJSONUnderV235-1723903125-project-member] Enqueued Resource ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 with Priority: HIGHEST for action security_group_rules [ 967.194399] env[70006]: INFO networking_nsxv3.common.synchronization [req-ccd8fda7-d438-49a3-8d1d-e6a03c5469aa req-77a1a9e2-0466-46fd-b3bf-9a333436795d tempest-ServerRescueTestJSONUnderV235-1723903125 tempest-ServerRescueTestJSONUnderV235-1723903125-project-member] Enqueued Resource ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 with Priority: HIGHEST for action security_group_members [ 967.194534] env[70006]: INFO networking_nsxv3.common.synchronization [req-ccd8fda7-d438-49a3-8d1d-e6a03c5469aa req-77a1a9e2-0466-46fd-b3bf-9a333436795d tempest-ServerRescueTestJSONUnderV235-1723903125 tempest-ServerRescueTestJSONUnderV235-1723903125-project-member] Enqueued Resource ID: 7beab378-23cf-4f47-8004-b917e0a1e482 with Priority: HIGHEST for action port [ 967.195089] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_rules [ 967.195237] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 with Priority: HIGHEST for action security_group_rules [ 967.195338] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7beab378-23cf-4f47-8004-b917e0a1e482 with Priority: HIGHEST for action port [ 967.195433] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_members [ 967.195519] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 with Priority: HIGHEST for action security_group_members [ 967.195810] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.195934] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.196112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.196219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.196298] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.197533] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdf7a3d7-d87d-4373-8fa5-c254d3dba846 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.197656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.197656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.197927] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.198013] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdf7a3d7-d87d-4373-8fa5-c254d3dba846',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.198860] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-7beab378-23cf-4f47-8004-b917e0a1e482 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.198975] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.199059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.199241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.199335] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7beab378-23cf-4f47-8004-b917e0a1e482',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.200117] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.200216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.200421] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.200519] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.585858] env[70006]: INFO networking_nsxv3.common.synchronization [req-ff3787f2-4ffc-44c0-aa65-bf7654456b28 req-26487010-aeef-4461-a8a1-5d559ed11c14 tempest-ServerRescueTestJSONUnderV235-1723903125 tempest-ServerRescueTestJSONUnderV235-1723903125-project-member] Enqueued Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_members [ 967.585858] env[70006]: INFO networking_nsxv3.common.synchronization [req-ff3787f2-4ffc-44c0-aa65-bf7654456b28 req-26487010-aeef-4461-a8a1-5d559ed11c14 tempest-ServerRescueTestJSONUnderV235-1723903125 tempest-ServerRescueTestJSONUnderV235-1723903125-project-member] Enqueued Resource ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 with Priority: HIGHEST for action security_group_members [ 967.585858] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 967.585858] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.587038] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_members [ 967.587038] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 with Priority: HIGHEST for action security_group_members [ 967.587038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.587779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.587779] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.587779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.587779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.587779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.587779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.588865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.588865] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.590349] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.590349] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.590559] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.590680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.650175] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.654993] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdf7a3d7-d87d-4373-8fa5-c254d3dba846',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.657619] env[70006]: INFO networking_nsxv3.common.synchronization [req-ff3787f2-4ffc-44c0-aa65-bf7654456b28 req-26487010-aeef-4461-a8a1-5d559ed11c14 tempest-ServerRescueTestJSONUnderV235-1723903125 tempest-ServerRescueTestJSONUnderV235-1723903125-project-member] Enqueued Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_rules [ 967.657619] env[70006]: INFO networking_nsxv3.common.synchronization [req-ff3787f2-4ffc-44c0-aa65-bf7654456b28 req-26487010-aeef-4461-a8a1-5d559ed11c14 tempest-ServerRescueTestJSONUnderV235-1723903125 tempest-ServerRescueTestJSONUnderV235-1723903125-project-member] Enqueued Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_members [ 967.657619] env[70006]: INFO networking_nsxv3.common.synchronization [req-ff3787f2-4ffc-44c0-aa65-bf7654456b28 req-26487010-aeef-4461-a8a1-5d559ed11c14 tempest-ServerRescueTestJSONUnderV235-1723903125 tempest-ServerRescueTestJSONUnderV235-1723903125-project-member] Enqueued Resource ID: 7beab378-23cf-4f47-8004-b917e0a1e482 with Priority: HIGHEST for action port [ 967.658180] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_rules [ 967.659030] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_members [ 967.659030] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7beab378-23cf-4f47-8004-b917e0a1e482 with Priority: HIGHEST for action port [ 967.659030] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.659030] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.659030] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.659315] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.659315] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-7beab378-23cf-4f47-8004-b917e0a1e482 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.659315] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.701739] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.701883] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.702172] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.702248] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.702403] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7beab378-23cf-4f47-8004-b917e0a1e482 with status ACTIVE [ 967.702552] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.702656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.702723] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.703042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.703138] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.703512] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.703697] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.703787] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.704017] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.704144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.704411] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.704527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.704922] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.704922] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.704922] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.705092] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7beab378-23cf-4f47-8004-b917e0a1e482 is going to be updated. [ 967.730833] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.730833] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.730833] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.731056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.731201] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.734893] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.734893] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.734893] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.734893] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7beab378-23cf-4f47-8004-b917e0a1e482',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.093765] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.093765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.093765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.093765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.093765] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.093765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.093765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.094033] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.094033] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.094802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.094802] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.094802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.094802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.094802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.095048] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.095242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.095368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.095568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.095713] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.095827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.095981] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.158421] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.159581] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdf7a3d7-d87d-4373-8fa5-c254d3dba846',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.238806] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7beab378-23cf-4f47-8004-b917e0a1e482 with status ACTIVE [ 968.239069] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.239249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.239331] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.239699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.239699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.239832] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.239919] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.239919] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.240173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.240255] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.240443] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.240802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.241146] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.241399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.241399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.241553] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7beab378-23cf-4f47-8004-b917e0a1e482 is going to be updated. [ 968.271240] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.271463] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.271463] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.271713] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.271866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.272275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7beab378-23cf-4f47-8004-b917e0a1e482" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.598506] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46e7bb0e-3b0b-455c-8638-3cb59c191bf9: rpc.has_security_group_logging(os_id): False [ 968.624198] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.624441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.624660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.628107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.628107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.628107] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.628107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.628107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.628107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.628107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.628107] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.628107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.628107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.628107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.628107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.628107] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.628107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.629116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.629116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.629116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.629116] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be updated. [ 968.638550] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: SUCCESS [ 968.639253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.661833] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.662070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.662138] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.662321] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.662409] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.662511] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbe1012c-c0e9-492c-808f-64ce71e77277 is going to be updated. [ 968.664147] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.664758] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.664929] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.665158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.665250] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.665348] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 is going to be created. [ 968.692330] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.692330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.692330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.692330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.692330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.694997] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.695187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.696245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.696245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.696245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.697986] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.698125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.698179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.698349] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.698496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.708426] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 in Status: UNINITIALIZED for 2s [ 968.709217] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: IN_PROGRESS for 2s [ 968.719801] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: IN_PROGRESS for 2s [ 970.723340] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 in Status: SUCCESS [ 970.723340] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.723340] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.723620] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.723695] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.723813] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.723876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.724124] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.724278] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.724372] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdf7a3d7-d87d-4373-8fa5-c254d3dba846',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.725974] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: SUCCESS [ 970.726315] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.727184] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.727305] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.727535] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.727622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.727660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.727795] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.727867] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.727958] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.740176] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 970.740416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.230223] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.230397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.230486] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.230790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.230833] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.231134] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.231236] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.231236] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.231378] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.231558] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.231558] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 is going to be deleted. [ 971.236687] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.289048] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.289243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.289338] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.289533] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.289627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.289756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.289913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.290083] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.290252] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.290348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.290397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.290936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.290936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.290936] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdf7a3d7-d87d-4373-8fa5-c254d3dba846',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.740367] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.798212] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.798212] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.798366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.799120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.799120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.799120] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.799120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.799120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.799120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.799358] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.799358] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 already deleted. [ 971.799358] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.799483] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.799638] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.799784] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.799911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.799998] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.800178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.800254] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.800962] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdf7a3d7-d87d-4373-8fa5-c254d3dba846',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.952780] env[70006]: INFO networking_nsxv3.common.synchronization [req-773c58a4-e339-4677-b528-057e2228aea6 req-50ed1b63-4ad1-42c4-a349-629b4a1b5b6a tempest-ServersNegativeTestJSON-161729029 tempest-ServersNegativeTestJSON-161729029-project-member] Enqueued Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_members [ 971.954218] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_members [ 971.954701] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.954907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.955069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.958551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.958551] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.958551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.958551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.958551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.958551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.958551] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.244146] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.244146] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.244146] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.244146] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.244146] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.244146] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbe1012c-c0e9-492c-808f-64ce71e77277 is going to be updated. [ 972.289414] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.289414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.289414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.289414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.289414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.301849] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: IN_PROGRESS for 2s [ 972.303168] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.303451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.303602] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.303909] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.304105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.304390] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.305744] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.305744] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.305744] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.305744] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.305744] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 already deleted. [ 972.305744] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.305744] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdf7a3d7-d87d-4373-8fa5-c254d3dba846',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.332345] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-439 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.332508] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-439" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.332508] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-439" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.333248] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-439" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.334361] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.334557] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.334679] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.334982] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.335304] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.335443] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.335563] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.335676] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.335785] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.335900] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.336013] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.336480] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.362786] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.362786] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 972.362786] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.362786] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-439" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.362786] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-d8aacd8d-2fc2-477b-9d82-e101e20b0132 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.362786] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.363355] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.363355] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.363355] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8aacd8d-2fc2-477b-9d82-e101e20b0132',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.461901] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.461901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.461901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.461901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.461901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.461901] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.461901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.461901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.461901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.461901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.461901] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 already deleted. [ 972.461901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.809935] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdf7a3d7-d87d-4373-8fa5-c254d3dba846',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.866739] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.867065] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.867065] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.867503] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.867966] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.868227] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port d8aacd8d-2fc2-477b-9d82-e101e20b0132 not found, creating... [ 972.868731] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.869024] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.869264] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.869681] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.870049] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.870624] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.870862] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.870967] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.871275] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.871736] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.871736] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: d8aacd8d-2fc2-477b-9d82-e101e20b0132 is going to be created. [ 972.897121] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.897121] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.897121] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.897121] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.897523] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.897597] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.313745] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdf7a3d7-d87d-4373-8fa5-c254d3dba846: rpc.has_security_group_logging(os_id): False [ 973.333109] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.333447] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.333447] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.333556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.333735] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.333839] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.334557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.334557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.334557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.334557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.334557] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 is going to be created. [ 973.355675] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/fdf7a3d7-d87d-4373-8fa5-c254d3dba846], does not exist path=[/infra/domains/default/groups/fdf7a3d7-d87d-4373-8fa5-c254d3dba846]."\n}' [ 973.355969] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fdf7a3d7-d87d-4373-8fa5-c254d3dba846 [ 973.356083] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 973.396832] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.396832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.397103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.397144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.398144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.398461] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.398600] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.398635] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.398829] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.398911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.399112] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.399214] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.399279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.399475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.399563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.399608] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdf7a3d7-d87d-4373-8fa5-c254d3dba846 is going to be created. [ 973.422643] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/fdf7a3d7-d87d-4373-8fa5-c254d3dba846], does not exist path=[/infra/domains/default/groups/fdf7a3d7-d87d-4373-8fa5-c254d3dba846]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fdf7a3d7-d87d-4373-8fa5-c254d3dba846 [ 973.422895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdf7a3d7-d87d-4373-8fa5-c254d3dba846" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.423253] env[70006]: Traceback (most recent call last): [ 973.423253] env[70006]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 973.423253] env[70006]: return func(*args, **kwargs) [ 973.423253] env[70006]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 973.423253] env[70006]: res.raise_for_status() [ 973.423253] env[70006]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 973.423253] env[70006]: raise HTTPError(http_error_msg, response=self) [ 973.423470] env[70006]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fdf7a3d7-d87d-4373-8fa5-c254d3dba846 [ 973.423470] env[70006]: During handling of the above exception, another exception occurred: [ 973.423470] env[70006]: Traceback (most recent call last): [ 973.423470] env[70006]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 973.423470] env[70006]: listener.cb(fileno) [ 973.423470] env[70006]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 973.423470] env[70006]: result = function(*args, **kwargs) [ 973.423470] env[70006]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 973.423470] env[70006]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 973.423470] env[70006]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 973.423470] env[70006]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 973.423470] env[70006]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 973.423470] env[70006]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 973.423470] env[70006]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 973.423470] env[70006]: res.raise_for_status() [ 973.423470] env[70006]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 973.423470] env[70006]: raise HTTPError(http_error_msg, response=self) [ 973.423470] env[70006]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fdf7a3d7-d87d-4373-8fa5-c254d3dba846 [ 973.423470] env[70006]: Removing descriptor: 66 [ 973.649397] env[70006]: INFO networking_nsxv3.common.synchronization [req-773c58a4-e339-4677-b528-057e2228aea6 req-00cccd3e-1023-4fcd-a59a-842f0b03119d service nova] Enqueued Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_rules [ 973.649397] env[70006]: INFO networking_nsxv3.common.synchronization [req-773c58a4-e339-4677-b528-057e2228aea6 req-00cccd3e-1023-4fcd-a59a-842f0b03119d service nova] Enqueued Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_members [ 973.649397] env[70006]: INFO networking_nsxv3.common.synchronization [req-773c58a4-e339-4677-b528-057e2228aea6 req-00cccd3e-1023-4fcd-a59a-842f0b03119d service nova] Enqueued Resource ID: d8aacd8d-2fc2-477b-9d82-e101e20b0132 with Priority: HIGHEST for action port [ 973.653208] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_rules [ 973.653372] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_members [ 973.653535] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8aacd8d-2fc2-477b-9d82-e101e20b0132 with Priority: HIGHEST for action port [ 973.653915] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.654052] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.654052] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.655340] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.655340] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.655522] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.656133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.656213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.656409] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.658796] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.658796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.658796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.658796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.658796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.658796] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.658796] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8aacd8d-2fc2-477b-9d82-e101e20b0132 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.658796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.658796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.658796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.658796] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8aacd8d-2fc2-477b-9d82-e101e20b0132',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.160750] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.161123] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.161219] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.162219] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8aacd8d-2fc2-477b-9d82-e101e20b0132 with status ACTIVE [ 974.162415] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.162554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.162598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.166020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.166020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.166020] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.166020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.166020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.166020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.166020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.166020] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.166020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.166020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.166020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.166020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.166020] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8aacd8d-2fc2-477b-9d82-e101e20b0132 is going to be updated. [ 974.186924] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.187093] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.187166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.187380] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.187519] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.187682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.291928] env[70006]: INFO networking_nsxv3.common.synchronization [req-232e62ce-fba2-40b7-b09e-9c8d1db96fda req-3247f137-db69-4982-82a6-530707df8723 tempest-ListServerFiltersTestJSON-2066587110 tempest-ListServerFiltersTestJSON-2066587110-project-member] Enqueued Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 974.292489] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 974.292788] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.292913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.292980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.293342] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.293752] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.293752] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.293752] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.294330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.294477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.294626] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.312097] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: SUCCESS [ 974.312097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.312097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.312919] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.312919] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.312919] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.312919] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.315836] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.315926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.316046] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.620477] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-231 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.620782] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-231" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.620927] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-231" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.621277] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-231" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.621565] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.621736] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.621860] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.622098] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.622254] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.622472] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 974.622592] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.622708] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.622817] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.622929] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 974.623050] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.623186] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.642421] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.642609] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 974.642733] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.643083] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-231" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.643453] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-20f2f376-c1c7-4171-bc55-1ecdb0cc5d14 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.643643] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-20f2f376-c1c7-4171-bc55-1ecdb0cc5d14" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.643849] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-20f2f376-c1c7-4171-bc55-1ecdb0cc5d14" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.644247] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-20f2f376-c1c7-4171-bc55-1ecdb0cc5d14" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.644401] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20f2f376-c1c7-4171-bc55-1ecdb0cc5d14',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.666508] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.799168] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.799348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.799401] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.799608] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.799697] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.799942] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.800028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.800063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.800195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.800268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.800350] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152fa45c-61d1-4b26-872b-ee9494b58bea already deleted. [ 974.800429] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.818720] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.147352] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.147610] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.147700] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.147990] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.148163] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.148324] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 20f2f376-c1c7-4171-bc55-1ecdb0cc5d14 not found, creating... [ 975.148591] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.148794] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.148870] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.149119] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.149258] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.149534] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.149692] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.149813] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.150034] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.150175] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.150314] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 20f2f376-c1c7-4171-bc55-1ecdb0cc5d14 is going to be created. [ 975.171642] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.172010] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.172010] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.172287] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.172524] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.172756] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-20f2f376-c1c7-4171-bc55-1ecdb0cc5d14" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.173672] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.173807] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.173878] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.174156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.174246] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.174339] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 is going to be created. [ 975.198619] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.198859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.198936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.199175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.199362] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.209841] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: UNINITIALIZED for 2s [ 975.321200] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.670768] env[70006]: INFO networking_nsxv3.common.synchronization [req-4938dd96-a930-47aa-8a53-bd2354367581 req-7fb44c65-484b-4032-97ed-9609b1fd3091 tempest-ServerRescueTestJSONUnderV235-1723903125 tempest-ServerRescueTestJSONUnderV235-1723903125-project-member] Enqueued Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_members [ 975.671158] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe1012c-c0e9-492c-808f-64ce71e77277 with Priority: HIGHEST for action security_group_members [ 975.671158] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.671302] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.823521] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.823672] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.823741] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.824053] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.824139] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.824239] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbe1012c-c0e9-492c-808f-64ce71e77277 is going to be updated. [ 975.858348] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.858348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.858348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.859997] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.859997] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.872028] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: IN_PROGRESS for 2s [ 975.942901] env[70006]: INFO networking_nsxv3.common.synchronization [req-232e62ce-fba2-40b7-b09e-9c8d1db96fda req-9f53211d-2944-4bb3-9b67-f8603d805993 service nova] Enqueued Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_rules [ 975.943101] env[70006]: INFO networking_nsxv3.common.synchronization [req-232e62ce-fba2-40b7-b09e-9c8d1db96fda req-9f53211d-2944-4bb3-9b67-f8603d805993 service nova] Enqueued Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 975.943242] env[70006]: INFO networking_nsxv3.common.synchronization [req-232e62ce-fba2-40b7-b09e-9c8d1db96fda req-9f53211d-2944-4bb3-9b67-f8603d805993 service nova] Enqueued Resource ID: 20f2f376-c1c7-4171-bc55-1ecdb0cc5d14 with Priority: HIGHEST for action port [ 975.943486] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_rules [ 975.943616] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 975.943709] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20f2f376-c1c7-4171-bc55-1ecdb0cc5d14 with Priority: HIGHEST for action port [ 975.944295] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.944420] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.944484] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.944789] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.944868] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.945773] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.945891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.946028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.946141] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.946314] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.946419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.946555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.946632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.946719] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.946810] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.947565] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-20f2f376-c1c7-4171-bc55-1ecdb0cc5d14 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.947676] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20f2f376-c1c7-4171-bc55-1ecdb0cc5d14" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.947743] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20f2f376-c1c7-4171-bc55-1ecdb0cc5d14" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.947893] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20f2f376-c1c7-4171-bc55-1ecdb0cc5d14" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.947965] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20f2f376-c1c7-4171-bc55-1ecdb0cc5d14',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.450034] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.450034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.450389] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.451451] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20f2f376-c1c7-4171-bc55-1ecdb0cc5d14 with status ACTIVE [ 976.451606] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.451747] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.451816] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.452034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.452197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.452308] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.452403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.452476] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.452614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.452692] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.452916] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.453088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.453163] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.453305] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.453383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.453472] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20f2f376-c1c7-4171-bc55-1ecdb0cc5d14 is going to be updated. [ 976.476764] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.476953] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.477044] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.477295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.477461] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.477634] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20f2f376-c1c7-4171-bc55-1ecdb0cc5d14" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.955445] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.220810] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: SUCCESS [ 977.221048] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.221249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.221503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.221730] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.221855] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.221921] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.222119] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.222213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.222304] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.222400] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.459162] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.459473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.459473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.459698] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.459830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.459959] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152fa45c-61d1-4b26-872b-ee9494b58bea is going to be created. [ 977.486366] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.486366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.486366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.487146] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.487146] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.498569] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: UNINITIALIZED for 2s [ 977.724687] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.724854] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.724897] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.725703] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.725703] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.725703] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.725703] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.725703] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.725935] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.725935] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.726156] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.726308] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.726364] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.726677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.726677] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.727247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.727247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.727247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.727343] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.727424] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.727559] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.867372] env[70006]: INFO networking_nsxv3.common.synchronization [req-a95340f5-5734-4e1e-a18c-04844bbe1b85 req-2fee12dd-aa92-4bf0-ad2d-0e3f03ca2e76 tempest-ListServerFiltersTestJSON-2066587110 tempest-ListServerFiltersTestJSON-2066587110-project-member] Enqueued Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 977.868029] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 977.868333] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.868608] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.886271] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: SUCCESS [ 977.886558] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.887204] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.887477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.887706] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.887845] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.887917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.888100] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.888195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.889333] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.159243] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-231 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.159457] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-231" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.159588] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-231" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.159868] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-231" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.160144] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.160332] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.160663] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.160799] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.160860] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.161094] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 978.161214] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.161324] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.161436] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.161579] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 978.161721] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.161824] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.181674] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.181927] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 978.182089] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.182270] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-231" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.182589] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-36c36a41-a7ab-45a3-a1c4-be24ecb013e7 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.182778] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-36c36a41-a7ab-45a3-a1c4-be24ecb013e7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.182899] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-36c36a41-a7ab-45a3-a1c4-be24ecb013e7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.183239] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-36c36a41-a7ab-45a3-a1c4-be24ecb013e7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.183388] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36c36a41-a7ab-45a3-a1c4-be24ecb013e7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.229648] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85d75a9b-90ae-4f22-b7a1-48280a25caf8: rpc.has_security_group_logging(os_id): False [ 978.253829] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.254035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.254574] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.254574] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.254574] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.254723] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.254777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.254878] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.255043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.255137] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.255377] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.255902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.255902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.255902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.255902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.256172] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.256172] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.256252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.256392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.256473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.256559] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 is going to be created. [ 978.332551] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.332688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.332762] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.332980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.333181] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.344342] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: IN_PROGRESS for 2s [ 978.391411] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.391411] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.391411] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.391670] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.449018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.449306] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.449433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.449497] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.449709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.450356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.450356] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbe1012c-c0e9-492c-808f-64ce71e77277 is going to be updated. [ 978.489345] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.490085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.490259] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.490643] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.490987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.502913] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: IN_PROGRESS for 2s [ 978.686191] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.686438] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.686607] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.686874] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.687047] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.687224] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 36c36a41-a7ab-45a3-a1c4-be24ecb013e7 not found, creating... [ 978.687493] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.687655] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.687780] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.688015] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.688168] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.688456] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.688730] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.688866] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.689091] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.689237] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.689423] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 36c36a41-a7ab-45a3-a1c4-be24ecb013e7 is going to be created. [ 978.713851] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.713851] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.714093] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.714316] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.714566] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.714951] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-36c36a41-a7ab-45a3-a1c4-be24ecb013e7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.506075] env[70006]: INFO networking_nsxv3.common.synchronization [req-a95340f5-5734-4e1e-a18c-04844bbe1b85 req-3f769e4f-faa5-4013-80eb-f04f82efaf90 service nova] Enqueued Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_rules [ 979.506370] env[70006]: INFO networking_nsxv3.common.synchronization [req-a95340f5-5734-4e1e-a18c-04844bbe1b85 req-3f769e4f-faa5-4013-80eb-f04f82efaf90 service nova] Enqueued Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 979.506531] env[70006]: INFO networking_nsxv3.common.synchronization [req-a95340f5-5734-4e1e-a18c-04844bbe1b85 req-3f769e4f-faa5-4013-80eb-f04f82efaf90 service nova] Enqueued Resource ID: 36c36a41-a7ab-45a3-a1c4-be24ecb013e7 with Priority: HIGHEST for action port [ 979.507549] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_rules [ 979.507699] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 979.507799] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c36a41-a7ab-45a3-a1c4-be24ecb013e7 with Priority: HIGHEST for action port [ 979.508107] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.508216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.508432] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.508520] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.508718] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-36c36a41-a7ab-45a3-a1c4-be24ecb013e7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.508871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36c36a41-a7ab-45a3-a1c4-be24ecb013e7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.508871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36c36a41-a7ab-45a3-a1c4-be24ecb013e7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.510131] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36c36a41-a7ab-45a3-a1c4-be24ecb013e7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.510235] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36c36a41-a7ab-45a3-a1c4-be24ecb013e7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.516323] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: SUCCESS [ 979.516323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.516323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.516323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.516323] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.516323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.516323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.516323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.516933] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.516933] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.516933] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.518492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.519214] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.519875] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.520050] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.520148] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.523027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.523027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.523027] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.649407] env[70006]: INFO networking_nsxv3.common.synchronization [req-62a18c5d-b81c-43d1-ba1a-6c72fe4c5131 req-b5d6f935-2abf-4938-bf47-228af30c3334 tempest-ImagesTestJSON-196229908 tempest-ImagesTestJSON-196229908-project-member] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 979.650043] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 979.650353] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.650496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.650547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.650787] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.650948] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.651159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.651228] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.651442] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.651472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.654119] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.013089] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36c36a41-a7ab-45a3-a1c4-be24ecb013e7 with status ACTIVE [ 980.013391] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.013564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.013660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.013966] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.014124] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.014389] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.014508] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.014574] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.014739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.014826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.015022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.015114] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.015176] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.015318] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.015393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.015478] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36c36a41-a7ab-45a3-a1c4-be24ecb013e7 is going to be updated. [ 980.019272] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.019410] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.023883] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.040259] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.040259] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.040259] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.040259] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.040259] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.040259] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36c36a41-a7ab-45a3-a1c4-be24ecb013e7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.160992] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.357593] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: SUCCESS [ 980.357593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.514195] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: SUCCESS [ 980.514541] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbe1012c-c0e9-492c-808f-64ce71e77277 deletion is rescheduled due to dependency. [ 980.514541] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.514916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.515047] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.515329] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.515514] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.515612] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.515849] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.515994] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.516170] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.516330] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.517368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.518291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.518551] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.518766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.518887] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.519105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.519233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.519383] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.526177] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.564441] env[70006]: INFO networking_nsxv3.common.synchronization [req-3109eb60-e869-4959-b970-bdace95cf0ab req-eea60e3a-ffe3-422e-bedb-ac81804ee2f3 tempest-ListServerFiltersTestJSON-2066587110 tempest-ListServerFiltersTestJSON-2066587110-project-member] Enqueued Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 980.564441] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 980.564441] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.564874] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.665748] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.924461] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-231 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.924695] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-231" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.924839] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-231" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.925180] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-231" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.925458] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.925640] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.925853] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.926135] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.927025] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.927025] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 980.927025] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.927025] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.927025] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.927025] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 980.927312] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.927312] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.947241] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.947398] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 980.947659] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.947730] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-231" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.948063] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-e7899a16-e277-4a87-8992-3900bdc7c327 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.948249] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-e7899a16-e277-4a87-8992-3900bdc7c327" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.948379] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-e7899a16-e277-4a87-8992-3900bdc7c327" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.948859] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-e7899a16-e277-4a87-8992-3900bdc7c327" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.948923] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7899a16-e277-4a87-8992-3900bdc7c327',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.021596] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.021746] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.022041] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.022154] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.022225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.022503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.022623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.022808] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.023054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.023054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.023165] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.023242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.023330] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbe1012c-c0e9-492c-808f-64ce71e77277 is going to be updated. [ 981.029300] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.029300] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.029300] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.029640] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.029640] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.029640] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152fa45c-61d1-4b26-872b-ee9494b58bea is going to be updated. [ 981.051831] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.051976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.052088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.052269] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.052410] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.054222] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.054354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.054400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.054566] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.054693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.065686] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: IN_PROGRESS for 2s [ 981.066384] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: IN_PROGRESS for 2s [ 981.168678] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.168924] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.169011] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.169253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.169362] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.169472] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be updated. [ 981.223466] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.223659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.223705] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.223896] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.224064] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.234330] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: IN_PROGRESS for 2s [ 981.452283] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.452524] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.453287] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.453584] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.453747] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.453913] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port e7899a16-e277-4a87-8992-3900bdc7c327 not found, creating... [ 981.454205] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.454372] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.454495] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.454716] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.454859] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.455234] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.455408] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.455522] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.455733] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.455872] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.456026] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: e7899a16-e277-4a87-8992-3900bdc7c327 is going to be created. [ 981.478719] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.478719] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.478719] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.479175] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.479175] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.479360] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-e7899a16-e277-4a87-8992-3900bdc7c327" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.764808] env[70006]: INFO networking_nsxv3.common.synchronization [None req-1ba5145d-791a-491c-86fa-3bbadf120b97 tempest-ServerActionsTestJSON-71305913 tempest-ServerActionsTestJSON-71305913-project-member] Enqueued Resource ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 with Priority: HIGHEST for action security_group_rules [ 981.765746] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 with Priority: HIGHEST for action security_group_rules [ 981.766082] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.766192] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.766257] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.766516] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.766606] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15b2f848-e9f8-46b8-b9dc-b82509a3b126',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.107832] env[70006]: INFO networking_nsxv3.common.synchronization [None req-bd9d905d-1ca2-4141-907a-ccdc223654d0 tempest-ServerActionsTestJSON-71305913 tempest-ServerActionsTestJSON-71305913-project-member] Enqueued Resource ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 with Priority: HIGHEST for action security_group_rules [ 982.108461] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 with Priority: HIGHEST for action security_group_rules [ 982.108806] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.108950] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.208124] env[70006]: INFO networking_nsxv3.common.synchronization [req-3109eb60-e869-4959-b970-bdace95cf0ab req-a08224b2-c36f-47d0-8037-f2e1142cc83d service nova] Enqueued Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_rules [ 982.208446] env[70006]: INFO networking_nsxv3.common.synchronization [req-3109eb60-e869-4959-b970-bdace95cf0ab req-a08224b2-c36f-47d0-8037-f2e1142cc83d service nova] Enqueued Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 982.208755] env[70006]: INFO networking_nsxv3.common.synchronization [req-3109eb60-e869-4959-b970-bdace95cf0ab req-a08224b2-c36f-47d0-8037-f2e1142cc83d service nova] Enqueued Resource ID: e7899a16-e277-4a87-8992-3900bdc7c327 with Priority: HIGHEST for action port [ 982.209847] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_rules [ 982.209847] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 982.209847] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7899a16-e277-4a87-8992-3900bdc7c327 with Priority: HIGHEST for action port [ 982.213550] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.213550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.213550] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.213550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.213550] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7899a16-e277-4a87-8992-3900bdc7c327 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.213550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7899a16-e277-4a87-8992-3900bdc7c327" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.213550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7899a16-e277-4a87-8992-3900bdc7c327" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.213550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7899a16-e277-4a87-8992-3900bdc7c327" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.213550] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7899a16-e277-4a87-8992-3900bdc7c327',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.288016] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.288016] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.288138] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.288309] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.288404] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.288535] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 already deleted. [ 982.289278] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.289551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.289795] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.289917] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15b2f848-e9f8-46b8-b9dc-b82509a3b126',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.715707] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7899a16-e277-4a87-8992-3900bdc7c327 with status ACTIVE [ 982.715958] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.716115] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.716224] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.716469] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.716562] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.716741] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.716838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.716905] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.718580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.718580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.718580] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.718580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.718580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.718580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.718580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.718580] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7899a16-e277-4a87-8992-3900bdc7c327 is going to be updated. [ 982.739113] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.739301] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.739372] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.739579] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.739719] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.739944] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7899a16-e277-4a87-8992-3900bdc7c327" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.821475] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.821475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.821475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.821475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.821475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.821475] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 already deleted. [ 982.821475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.078983] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: SUCCESS [ 983.080246] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.081061] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: SUCCESS [ 983.081220] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbe1012c-c0e9-492c-808f-64ce71e77277 deletion is rescheduled due to dependency. [ 983.081316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.081466] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.081714] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.081852] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.081964] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.082661] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.082887] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.082994] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.083125] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.084023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.084200] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.084367] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.084485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.084550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.084695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.084774] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.084856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.088148] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe1012c-c0e9-492c-808f-64ce71e77277 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.088257] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.088323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.088474] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.088624] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.088719] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.088797] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.088938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.089158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.089268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.089608] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.244531] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 983.244762] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.591573] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.597274] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbe1012c-c0e9-492c-808f-64ce71e77277: rpc.has_security_group_logging(os_id): False [ 983.618275] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.618488] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.618554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.618770] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.618858] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.619059] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.619156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.619216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.619365] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.619438] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.619652] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.619805] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.619902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.620801] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.621932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.621932] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.621932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.621932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.621932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.621932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.621932] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbe1012c-c0e9-492c-808f-64ce71e77277 is going to be updated. [ 983.687780] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.687948] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.688032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.688319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.688506] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.708572] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: IN_PROGRESS for 2s [ 983.735339] env[70006]: INFO networking_nsxv3.common.synchronization [req-c036ac33-a915-48a8-9adc-00c6fbd12462 req-c198da7c-db7c-4d2c-8bd9-de8736f90479 tempest-ServerGroupTestJSON-1018463365 tempest-ServerGroupTestJSON-1018463365-project-member] Enqueued Resource ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba with Priority: HIGHEST for action security_group_members [ 983.735339] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba with Priority: HIGHEST for action security_group_members [ 983.735339] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.735339] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.735711] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.735711] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.735861] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.736036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.736126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.736366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.736498] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.736644] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df5faca2-f036-4823-a1d7-4ca3af9ed4ba',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.095435] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.100114] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-768 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.100325] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-768" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.100456] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-768" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.100849] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-768" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.101152] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.101323] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.101451] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.101765] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.101875] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.102115] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 984.102237] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 984.102354] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 984.102470] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 984.102585] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 984.102699] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 984.102869] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 984.124909] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 984.125143] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 984.125300] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 984.125490] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-768" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.125994] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.126517] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.126517] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.126911] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.127076] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.239194] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.239376] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.239454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.239707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.239854] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.240119] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.240254] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.240322] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.240511] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.240692] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.240814] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba already deleted. [ 984.240940] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.598468] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.598843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.598843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.599059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.599135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.599247] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152fa45c-61d1-4b26-872b-ee9494b58bea is going to be updated. [ 984.629183] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.629437] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.629437] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.629605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.630024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.633812] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.634055] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.634168] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.634419] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.634570] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.634724] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7 not found, creating... [ 984.634987] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.635165] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.635290] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.635519] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.635702] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.636140] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.636385] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.636576] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.636882] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.637111] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.637321] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7 is going to be created. [ 984.649919] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: IN_PROGRESS for 2s [ 984.663178] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.663562] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.663772] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.664133] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.664433] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.664735] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.411740] env[70006]: INFO networking_nsxv3.common.synchronization [req-c036ac33-a915-48a8-9adc-00c6fbd12462 req-959bffc9-a3f9-40f4-bfc8-fd96f36946b7 service nova] Enqueued Resource ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba with Priority: HIGHEST for action security_group_rules [ 985.411996] env[70006]: INFO networking_nsxv3.common.synchronization [req-c036ac33-a915-48a8-9adc-00c6fbd12462 req-959bffc9-a3f9-40f4-bfc8-fd96f36946b7 service nova] Enqueued Resource ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba with Priority: HIGHEST for action security_group_members [ 985.412244] env[70006]: INFO networking_nsxv3.common.synchronization [req-c036ac33-a915-48a8-9adc-00c6fbd12462 req-959bffc9-a3f9-40f4-bfc8-fd96f36946b7 service nova] Enqueued Resource ID: ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7 with Priority: HIGHEST for action port [ 985.412368] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba with Priority: HIGHEST for action security_group_rules [ 985.412441] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba with Priority: HIGHEST for action security_group_members [ 985.412547] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7 with Priority: HIGHEST for action port [ 985.413114] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df5faca2-f036-4823-a1d7-4ca3af9ed4ba taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.413244] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.413305] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.413562] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.413670] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df5faca2-f036-4823-a1d7-4ca3af9ed4ba',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.417223] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.417223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.417223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.417223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.417223] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.417223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.417223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.417223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.417223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.417223] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df5faca2-f036-4823-a1d7-4ca3af9ed4ba',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.417223] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.417223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.417223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.417223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.417223] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.724867] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbe1012c-c0e9-492c-808f-64ce71e77277 in Status: SUCCESS [ 985.725144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.725324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.725575] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.725666] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbe1012c-c0e9-492c-808f-64ce71e77277',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.746848] env[70006]: INFO networking_nsxv3.common.synchronization [req-952887b7-5920-4d76-ac0a-1b55ec6c6663 req-0b0d6adb-7ae4-4a1d-b99b-2816fa28622a tempest-ServersTestJSON-1431904245 tempest-ServersTestJSON-1431904245-project-member] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 985.747422] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 985.748877] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.748877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.748877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.748877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.748877] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.748877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.748877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.749272] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.749272] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.749272] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.919042] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.919042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.919042] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df5faca2-f036-4823-a1d7-4ca3af9ed4ba',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.920390] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7 with status ACTIVE [ 985.921592] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.921592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.921592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.921592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.921592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.921592] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.921592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.921592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.922088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.922088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.922088] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.922088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.922212] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.922278] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.922348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.922429] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7 is going to be updated. [ 985.944075] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.944249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.944324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.944529] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.944665] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.944828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccf0fb0e-eb83-4463-acc1-fc5bab8a5fb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.081780] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.081999] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.082158] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.082452] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.084380] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.084645] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.084790] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.085084] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.085251] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.085470] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.085590] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.085703] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.085817] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.085928] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.086055] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.086199] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.106776] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.107479] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 986.107479] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.107479] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.108049] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-a9940c14-e6da-4fa5-b093-ba598b0bdc93 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.108049] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-a9940c14-e6da-4fa5-b093-ba598b0bdc93" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.108049] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-a9940c14-e6da-4fa5-b093-ba598b0bdc93" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.109298] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-a9940c14-e6da-4fa5-b093-ba598b0bdc93" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.109298] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9940c14-e6da-4fa5-b093-ba598b0bdc93',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.249533] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.249716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.249790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.250012] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.250110] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.250238] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbe1012c-c0e9-492c-808f-64ce71e77277 is going to be deleted. [ 986.251546] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.328436] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.328436] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.328436] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.328941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.329166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.329369] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbe1012c-c0e9-492c-808f-64ce71e77277" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.425251] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df5faca2-f036-4823-a1d7-4ca3af9ed4ba',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.611040] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.611391] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.611563] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.611833] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.612015] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.612186] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port a9940c14-e6da-4fa5-b093-ba598b0bdc93 not found, creating... [ 986.612482] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.612682] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.612792] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.613078] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.613242] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.613617] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.613805] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.613934] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.614764] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.614926] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.615099] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: a9940c14-e6da-4fa5-b093-ba598b0bdc93 is going to be created. [ 986.636765] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.636925] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.637077] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.637390] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.637666] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.638485] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-a9940c14-e6da-4fa5-b093-ba598b0bdc93" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.662205] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: SUCCESS [ 986.662433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.662606] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.662843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.663063] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.663187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.663282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.663407] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.663479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.663569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.663734] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.663816] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.663875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.664122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.664293] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.664391] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.664451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.664591] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.664667] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.664750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.664849] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.665752] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.665922] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.666090] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.666190] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.666253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.666395] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.666472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.666561] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.754114] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.928106] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.928288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.928376] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.928646] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.928763] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.928866] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba is going to be created. [ 986.967162] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.967162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.967162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.968139] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.968139] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.981039] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba in Status: UNINITIALIZED for 2s [ 987.168436] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 152fa45c-61d1-4b26-872b-ee9494b58bea: rpc.has_security_group_logging(os_id): False [ 987.170772] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.194777] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.195808] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.196187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.196569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.196781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.197264] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.197523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.197622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.197870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.197982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.198295] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.198430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.198656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.198710] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.198817] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.199253] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.199521] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.199521] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.199682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.199789] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.199955] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 152fa45c-61d1-4b26-872b-ee9494b58bea is going to be created. [ 987.258261] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.258525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.258525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.259085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.259212] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.259483] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 987.304222] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.304222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.304222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.304222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.304682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.306582] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.306770] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.306809] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.307046] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.307179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.322437] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 987.323613] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: IN_PROGRESS for 2s [ 987.560696] env[70006]: INFO networking_nsxv3.common.synchronization [req-952887b7-5920-4d76-ac0a-1b55ec6c6663 req-edd82552-7a3e-4ad7-b8d1-aedc6f43eff8 service nova] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_rules [ 987.561037] env[70006]: INFO networking_nsxv3.common.synchronization [req-952887b7-5920-4d76-ac0a-1b55ec6c6663 req-edd82552-7a3e-4ad7-b8d1-aedc6f43eff8 service nova] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 987.563944] env[70006]: INFO networking_nsxv3.common.synchronization [req-952887b7-5920-4d76-ac0a-1b55ec6c6663 req-edd82552-7a3e-4ad7-b8d1-aedc6f43eff8 service nova] Enqueued Resource ID: a9940c14-e6da-4fa5-b093-ba598b0bdc93 with Priority: HIGHEST for action port [ 987.565033] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_rules [ 987.565033] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 987.565033] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9940c14-e6da-4fa5-b093-ba598b0bdc93 with Priority: HIGHEST for action port [ 987.565033] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.565563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.565563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.565563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.565688] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.566881] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.567178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.568114] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9940c14-e6da-4fa5-b093-ba598b0bdc93 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.568114] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9940c14-e6da-4fa5-b093-ba598b0bdc93" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.568114] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9940c14-e6da-4fa5-b093-ba598b0bdc93" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.568114] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9940c14-e6da-4fa5-b093-ba598b0bdc93" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.568114] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9940c14-e6da-4fa5-b093-ba598b0bdc93',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.672774] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.069759] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.069908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.070154] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9940c14-e6da-4fa5-b093-ba598b0bdc93 with status ACTIVE [ 988.070369] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.070484] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.070555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.070864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.070935] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.071137] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.071241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.071311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.071492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.071580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.071822] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.071929] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.071994] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.072158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.072258] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.072335] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9940c14-e6da-4fa5-b093-ba598b0bdc93 is going to be updated. [ 988.094654] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.094807] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.094879] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.095156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.095305] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.095480] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9940c14-e6da-4fa5-b093-ba598b0bdc93" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.175892] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.176093] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.176199] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.176499] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.176655] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.176818] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152fa45c-61d1-4b26-872b-ee9494b58bea is going to be updated. [ 988.209327] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.209493] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.209558] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.209927] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.210121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.232299] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: IN_PROGRESS for 2s [ 988.993239] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba in Status: SUCCESS [ 988.993613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.993798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.994063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.994260] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.994375] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.994440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.994593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.994704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.994769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.994847] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df5faca2-f036-4823-a1d7-4ca3af9ed4ba',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.333190] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 989.333451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.333655] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.333895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.334120] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.334279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.334364] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.334555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.334555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.334730] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.343933] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: SUCCESS [ 989.344344] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.344553] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.344876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.345030] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.500126] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.500126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.500126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.500275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.501028] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.501028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.501028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.501028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.501251] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.501491] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.501715] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.501839] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.501902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.503062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.503062] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.503062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.503062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.503062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.503062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.503062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.503062] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df5faca2-f036-4823-a1d7-4ca3af9ed4ba',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.842516] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.852396] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.852615] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.005348] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df5faca2-f036-4823-a1d7-4ca3af9ed4ba: rpc.has_security_group_logging(os_id): False [ 990.026858] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.027077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.027168] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.027473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.027658] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.027866] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.028008] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.028109] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.028298] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.028382] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.028587] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.028722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.028802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.028970] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.029064] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.029295] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.029430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.029490] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.029642] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.029794] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.029891] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba is going to be created. [ 990.101444] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.101554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.101797] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.102091] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.102091] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.115827] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba in Status: IN_PROGRESS for 2s [ 990.245075] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: SUCCESS [ 990.245329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.245517] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.245799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.245945] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.246149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.246213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.246489] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.246602] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.246714] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.347809] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.749505] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.850541] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.850747] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.850826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.851011] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.851106] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.852013] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 990.882447] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.882646] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.882742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.882995] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.883169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.893507] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 991.251918] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.754367] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.754539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.754611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.754826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.754921] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.755033] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152fa45c-61d1-4b26-872b-ee9494b58bea is going to be updated. [ 991.790222] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.790376] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.790447] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.790767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.790970] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.800531] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: IN_PROGRESS for 2s [ 991.835274] env[70006]: INFO networking_nsxv3.common.synchronization [None req-8adec063-995e-45fe-b712-8fd2b2b249a7 None None] Enqueued Resource ID: 8455cf9b-c2c6-4456-9890-8168451c4ead with Priority: HIGHEST for action port [ 991.837058] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8455cf9b-c2c6-4456-9890-8168451c4ead with Priority: HIGHEST for action port [ 991.840531] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-8455cf9b-c2c6-4456-9890-8168451c4ead taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.843084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8455cf9b-c2c6-4456-9890-8168451c4ead" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.843084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8455cf9b-c2c6-4456-9890-8168451c4ead" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.843084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8455cf9b-c2c6-4456-9890-8168451c4ead" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.843084] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8455cf9b-c2c6-4456-9890-8168451c4ead',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.135168] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba in Status: SUCCESS [ 992.135168] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.344644] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8455cf9b-c2c6-4456-9890-8168451c4ead [ 992.346859] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.346859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.346859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.346859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.346859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.346859] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8455cf9b-c2c6-4456-9890-8168451c4ead already deleted. [ 992.346859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8455cf9b-c2c6-4456-9890-8168451c4ead" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.604084] env[70006]: INFO networking_nsxv3.common.synchronization [None req-62869d9e-349e-4a1f-bd0a-d61802a37671 tempest-ServersTestBootFromVolume-1562632258 tempest-ServersTestBootFromVolume-1562632258-project-member] Enqueued Resource ID: ec4d7bd2-dee8-4667-8923-366f583eec53 with Priority: HIGHEST for action security_group_rules [ 992.604592] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4d7bd2-dee8-4667-8923-366f583eec53 with Priority: HIGHEST for action security_group_rules [ 992.604901] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec4d7bd2-dee8-4667-8923-366f583eec53 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.605031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.605100] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.605344] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.605426] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec4d7bd2-dee8-4667-8923-366f583eec53',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.728140] env[70006]: INFO networking_nsxv3.common.synchronization [None req-1b755dd9-8844-425e-82a7-2fa2928c0b2e tempest-ServersTestBootFromVolume-1562632258 tempest-ServersTestBootFromVolume-1562632258-project-member] Enqueued Resource ID: ec4d7bd2-dee8-4667-8923-366f583eec53 with Priority: HIGHEST for action security_group_rules [ 992.728720] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4d7bd2-dee8-4667-8923-366f583eec53 with Priority: HIGHEST for action security_group_rules [ 992.729055] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec4d7bd2-dee8-4667-8923-366f583eec53 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.729155] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.904266] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 992.904516] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.904691] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.904920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.905141] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.905339] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.905448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.906242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.906242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.906242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.906242] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.131984] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.132177] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.132221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.132441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.132531] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.132627] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec4d7bd2-dee8-4667-8923-366f583eec53 already deleted. [ 993.132713] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.132867] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.133038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.133124] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec4d7bd2-dee8-4667-8923-366f583eec53',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.408537] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.408962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.408962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.410527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.410527] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.410527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.410527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.410527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.410527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.410527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.410527] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.410527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.410527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.410527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.410527] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.410527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.410527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.412264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.412264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.412264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.412264] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.658996] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.659164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.659226] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.659451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.659560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.659815] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec4d7bd2-dee8-4667-8923-366f583eec53 already deleted. [ 993.659815] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.817123] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: SUCCESS [ 993.817123] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.817123] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.817123] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.817123] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.817123] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.817123] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.817123] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.817123] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.817123] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.817123] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.913270] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b2723f9-b1dc-419e-b339-13aae985829f: rpc.has_security_group_logging(os_id): False [ 993.932758] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.933031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.933131] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.933460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.958253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.958370] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.958547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.958547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.958717] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.958805] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.959028] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.959135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.959201] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.959356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.959426] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.959620] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.959699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.959759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.959971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.960084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.960174] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 994.041518] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.041518] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.041518] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.041518] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.041518] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.055346] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 994.286148] env[70006]: INFO networking_nsxv3.common.synchronization [None req-7ea74a19-97ea-4e62-9bbf-2117c8416b62 None None] Enqueued Resource ID: d596352e-c5fa-4f25-9979-df63db8287d3 with Priority: HIGHEST for action port [ 994.286148] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d596352e-c5fa-4f25-9979-df63db8287d3 with Priority: HIGHEST for action port [ 994.286148] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-d596352e-c5fa-4f25-9979-df63db8287d3 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.286148] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d596352e-c5fa-4f25-9979-df63db8287d3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.286148] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d596352e-c5fa-4f25-9979-df63db8287d3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.286148] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d596352e-c5fa-4f25-9979-df63db8287d3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.286148] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d596352e-c5fa-4f25-9979-df63db8287d3',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.316964] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.316964] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.316964] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.317316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.317476] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.317601] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.317964] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.318216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.318330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.318495] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.319554] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.319554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.319554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.319554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.319554] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.319554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.319554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.319846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.319846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.319962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.320079] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.788891] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d596352e-c5fa-4f25-9979-df63db8287d3 [ 994.789242] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.789641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.789641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.789756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.789870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.789992] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d596352e-c5fa-4f25-9979-df63db8287d3 already deleted. [ 994.790117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d596352e-c5fa-4f25-9979-df63db8287d3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.823162] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 152fa45c-61d1-4b26-872b-ee9494b58bea: rpc.has_security_group_logging(os_id): False [ 994.841975] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.842208] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.842360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.842533] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.842659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.842963] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.843134] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.843205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.843400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.843478] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.844037] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.844037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.844037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.844250] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.844250] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.844424] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.844539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.844622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.844791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.844870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.844971] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 152fa45c-61d1-4b26-872b-ee9494b58bea is going to be updated. [ 994.917576] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.917576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.917576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.917576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.917576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.932860] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: IN_PROGRESS for 2s [ 996.071539] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 996.071539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.646681] env[70006]: INFO networking_nsxv3.common.synchronization [req-a47fcc18-d775-4861-8b0c-86bcf001d2f6 req-d1d0a254-f3f0-4149-ab93-c8222a8de914 tempest-ServerGroupTestJSON-1018463365 tempest-ServerGroupTestJSON-1018463365-project-member] Enqueued Resource ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba with Priority: HIGHEST for action security_group_members [ 996.646681] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba with Priority: HIGHEST for action security_group_members [ 996.646808] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.646887] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.646946] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.648225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.648392] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.648496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.648559] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.648786] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.648880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.649039] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df5faca2-f036-4823-a1d7-4ca3af9ed4ba',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.945780] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: SUCCESS [ 996.946191] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.946380] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.946614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.946705] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.150595] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.151082] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.151182] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.151680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.151825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.152096] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.152276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.152308] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.152908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.152908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.152908] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba is going to be updated. [ 997.191201] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.191201] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.191201] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.191201] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.191855] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.200960] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba in Status: IN_PROGRESS for 2s [ 997.448949] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.449172] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.449249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.449481] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.449660] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.449763] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.449846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.449993] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.450098] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.450186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.450316] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.954551] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.954707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.954859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.954998] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.955201] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.955303] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.955364] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.955518] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.955605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.955695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.955857] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.955923] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.955988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.956140] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.956278] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.956367] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.956434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.956589] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.956873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.956873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.956873] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.305633] env[70006]: INFO networking_nsxv3.common.synchronization [req-39da2bb1-0364-4c41-81b5-feee87c17c09 req-d941e036-8d6e-40cb-92e7-ebd975a76e8a tempest-DeleteServersTestJSON-472565240 tempest-DeleteServersTestJSON-472565240-project-member] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 998.306238] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 998.306612] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.306799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.306917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.307313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.307446] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.310525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.310525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.310525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.310525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.310525] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.460624] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 152fa45c-61d1-4b26-872b-ee9494b58bea: rpc.has_security_group_logging(os_id): False [ 998.483198] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.483198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.483198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.483198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.483198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.483198] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.483198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.483198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.483198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.483198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.483198] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.483198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.483198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.483198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.483198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.483734] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.483734] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.483734] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.483734] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.483734] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.483734] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 152fa45c-61d1-4b26-872b-ee9494b58bea is going to be updated. [ 998.560975] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.561187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.561253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.561466] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.561626] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.579719] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: IN_PROGRESS for 2s [ 998.811794] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.811968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.812055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.812277] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.833460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.833914] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.834561] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.834813] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.835131] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.835313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.835479] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 998.867018] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.867018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.867018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.867018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.867018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.877502] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 999.215987] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba in Status: SUCCESS [ 999.215987] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba deletion is rescheduled due to dependency. [ 999.215987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.598977] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: SUCCESS [ 1000.599636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.887671] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 1000.887885] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 deletion is rescheduled due to dependency. [ 1000.888045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.748248] env[70006]: INFO networking_nsxv3.common.synchronization [req-07863f97-4bfb-4c52-bddd-937c3aa7641f req-f394f80f-0e1e-4943-9859-9bb551f4a51d tempest-ServerRescueNegativeTestJSON-1434609939 tempest-ServerRescueNegativeTestJSON-1434609939-project-member] Enqueued Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_members [ 1002.749108] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGHEST for action security_group_members [ 1002.750216] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.750584] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.750860] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.751306] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.751719] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.752051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.752286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.752665] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.752953] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.753266] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.259760] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.259760] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.259760] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.259976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.286173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.286173] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.286173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.286173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.286173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.286173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.286173] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 is going to be updated. [ 1003.322647] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.322647] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.322647] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.322932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.322932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.334810] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: IN_PROGRESS for 2s [ 1005.347368] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 in Status: SUCCESS [ 1005.347733] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 deletion is rescheduled due to dependency. [ 1005.347733] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.750420] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1007.750795] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1008.350153] env[70006]: INFO networking_nsxv3.common.synchronization [req-c60e5809-0813-46c9-9161-2a568b0d635e req-bf470f29-99f0-4a5f-a619-f45874e0522d tempest-ListServerFiltersTestJSON-2066587110 tempest-ListServerFiltersTestJSON-2066587110-project-member] Enqueued Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 1008.350928] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 1008.351294] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.351803] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.351803] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.351803] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.352064] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.352124] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.352160] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.352305] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.352411] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.352509] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.856683] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.870645] env[70006]: INFO networking_nsxv3.common.synchronization [req-8f17da3c-c3ac-42b4-a3b9-6ba14ca53465 req-668934dc-21da-4f64-a22e-961469db179b tempest-ImagesTestJSON-196229908 tempest-ImagesTestJSON-196229908-project-member] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 1008.870645] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGHEST for action security_group_members [ 1008.870645] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.870645] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.870645] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.870645] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.870645] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.871393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.871393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.871393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.871393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.871595] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.359767] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.376108] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.376320] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.376461] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.376637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.399501] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.399801] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.399920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.400051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.400202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.400286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.400376] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be updated. [ 1009.430868] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.430868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.431062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.431163] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.431311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.441376] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: IN_PROGRESS for 2s [ 1009.832733] env[70006]: INFO networking_nsxv3.common.synchronization [req-d55536c2-1650-47e0-ae8d-68c9cb7d1af3 req-0da8a0a0-81a8-4fc6-a40c-34d52e18e48e tempest-ServersV294TestFqdnHostnames-1142748138 tempest-ServersV294TestFqdnHostnames-1142748138-project-member] Enqueued Resource ID: e45746ed-781c-4f14-807a-e9e8876db03b with Priority: HIGHEST for action security_group_members [ 1009.832733] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45746ed-781c-4f14-807a-e9e8876db03b with Priority: HIGHEST for action security_group_members [ 1009.833197] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e45746ed-781c-4f14-807a-e9e8876db03b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.833405] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.833552] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.833765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.834010] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.834171] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.834274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.834494] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.835116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.835277] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e45746ed-781c-4f14-807a-e9e8876db03b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.861698] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.862039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.862039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.862264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.862366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.862492] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152fa45c-61d1-4b26-872b-ee9494b58bea is going to be updated. [ 1009.894497] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.894637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.894752] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.894925] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.895128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.905279] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: IN_PROGRESS for 2s [ 1010.338113] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.338113] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.338336] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.338377] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.359780] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.359901] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.360327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.360327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.360327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.360480] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.360480] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45746ed-781c-4f14-807a-e9e8876db03b is going to be updated. [ 1010.401999] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.401999] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.402253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.402316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.402462] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.411626] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45746ed-781c-4f14-807a-e9e8876db03b in Status: IN_PROGRESS for 2s [ 1011.451847] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 in Status: SUCCESS [ 1011.452247] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 deletion is rescheduled due to dependency. [ 1011.452247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.899118] env[70006]: INFO networking_nsxv3.common.synchronization [None req-a7ac4819-c9b2-450d-b775-c1b8af5dfae8 tempest-AttachVolumeNegativeTest-242855104 tempest-AttachVolumeNegativeTest-242855104-project-member] Enqueued Resource ID: 0a781d55-4d9b-4427-802e-7ce107992cfb with Priority: HIGHEST for action security_group_rules [ 1011.899663] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a781d55-4d9b-4427-802e-7ce107992cfb with Priority: HIGHEST for action security_group_rules [ 1011.899974] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a781d55-4d9b-4427-802e-7ce107992cfb taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.903994] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a781d55-4d9b-4427-802e-7ce107992cfb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.904094] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a781d55-4d9b-4427-802e-7ce107992cfb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.904379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a781d55-4d9b-4427-802e-7ce107992cfb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.904476] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a781d55-4d9b-4427-802e-7ce107992cfb',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.916351] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: SUCCESS [ 1011.916461] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.973986] env[70006]: INFO networking_nsxv3.common.synchronization [None req-d7d5ef2e-c9a1-424c-8230-76d6236f80e8 tempest-AttachVolumeNegativeTest-242855104 tempest-AttachVolumeNegativeTest-242855104-project-member] Enqueued Resource ID: 0a781d55-4d9b-4427-802e-7ce107992cfb with Priority: HIGHEST for action security_group_rules [ 1011.974840] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a781d55-4d9b-4427-802e-7ce107992cfb with Priority: HIGHEST for action security_group_rules [ 1011.975302] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a781d55-4d9b-4427-802e-7ce107992cfb taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.975842] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a781d55-4d9b-4427-802e-7ce107992cfb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.089513] env[70006]: INFO networking_nsxv3.common.synchronization [None req-775b42c7-73d0-4679-9ca0-fc4f2d390e2a None None] Enqueued Resource ID: 5cc03584-7235-47e7-b40b-ffe702488314 with Priority: HIGHEST for action port [ 1012.089513] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cc03584-7235-47e7-b40b-ffe702488314 with Priority: HIGHEST for action port [ 1012.089871] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cc03584-7235-47e7-b40b-ffe702488314 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.089996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cc03584-7235-47e7-b40b-ffe702488314" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.090074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cc03584-7235-47e7-b40b-ffe702488314" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.090326] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cc03584-7235-47e7-b40b-ffe702488314" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.090413] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cc03584-7235-47e7-b40b-ffe702488314',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.423281] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e45746ed-781c-4f14-807a-e9e8876db03b in Status: SUCCESS [ 1012.423281] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e45746ed-781c-4f14-807a-e9e8876db03b deletion is rescheduled due to dependency. [ 1012.423434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.430974] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.431606] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.431606] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.431606] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.431606] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.431606] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a781d55-4d9b-4427-802e-7ce107992cfb already deleted. [ 1012.431877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a781d55-4d9b-4427-802e-7ce107992cfb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.431877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a781d55-4d9b-4427-802e-7ce107992cfb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.431933] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a781d55-4d9b-4427-802e-7ce107992cfb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.432610] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a781d55-4d9b-4427-802e-7ce107992cfb',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.594524] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5cc03584-7235-47e7-b40b-ffe702488314 [ 1012.598105] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.598105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.598105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.598105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.598105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.598105] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5cc03584-7235-47e7-b40b-ffe702488314 already deleted. [ 1012.598105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cc03584-7235-47e7-b40b-ffe702488314" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.953306] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.953464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.953557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.953777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.953881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.953978] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a781d55-4d9b-4427-802e-7ce107992cfb already deleted. [ 1012.954073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a781d55-4d9b-4427-802e-7ce107992cfb" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.734850] env[70006]: INFO networking_nsxv3.common.synchronization [None req-98cbe7d3-5cc3-4c58-bf57-9f2590659062 tempest-AttachInterfacesUnderV243Test-1270413728 tempest-AttachInterfacesUnderV243Test-1270413728-project-member] Enqueued Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_rules [ 1013.738103] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_rules [ 1013.738103] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.738103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.738103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.738103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.738103] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.809537] env[70006]: INFO networking_nsxv3.common.synchronization [None req-fd777f63-4550-4288-badd-398b7fdaaa11 tempest-AttachInterfacesUnderV243Test-1270413728 tempest-AttachInterfacesUnderV243Test-1270413728-project-member] Enqueued Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_rules [ 1013.810045] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_rules [ 1013.810354] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.810483] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.052564] env[70006]: INFO networking_nsxv3.common.synchronization [None req-ef9c506e-e548-41ee-8d6c-326a01eee556 None None] Enqueued Resource ID: 163d50ac-dd78-4507-be55-a48981b5c2c2 with Priority: HIGHEST for action port [ 1014.052860] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 163d50ac-dd78-4507-be55-a48981b5c2c2 with Priority: HIGHEST for action port [ 1014.053580] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-163d50ac-dd78-4507-be55-a48981b5c2c2 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.053809] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-163d50ac-dd78-4507-be55-a48981b5c2c2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.054120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-163d50ac-dd78-4507-be55-a48981b5c2c2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.054368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-163d50ac-dd78-4507-be55-a48981b5c2c2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.054459] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('163d50ac-dd78-4507-be55-a48981b5c2c2',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.258996] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.258996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.258996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.259183] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.259183] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.259272] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 already deleted. [ 1014.259360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.259512] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.259668] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.259752] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.557041] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 163d50ac-dd78-4507-be55-a48981b5c2c2 [ 1014.557041] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.557041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.557041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.557330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.557365] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.558034] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:163d50ac-dd78-4507-be55-a48981b5c2c2 already deleted. [ 1014.558034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-163d50ac-dd78-4507-be55-a48981b5c2c2" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.794102] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.794102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.794102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.794102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.794102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.794102] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 already deleted. [ 1014.794102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.546926] env[70006]: INFO networking_nsxv3.common.synchronization [req-67ddc384-4490-431a-9598-3f2f62200508 req-b32be91e-b77a-4d4f-89a8-7204d352f2d9 tempest-ServersNegativeTestJSON-161729029 tempest-ServersNegativeTestJSON-161729029-project-member] Enqueued Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_members [ 1015.547536] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_members [ 1015.547928] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.549210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.549210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.549210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.549450] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.549678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.549763] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.550477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.550477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.550477] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.897769] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-439 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.898083] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-439" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.898208] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-439" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.898521] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-439" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.898879] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.899125] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.899315] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.899577] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.899768] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.900055] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.900293] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.900446] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.900593] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.900721] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.900882] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.901009] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.923278] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.923454] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1015.923596] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.923775] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-439" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.924112] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-4bbb7861-dce4-4ba4-9a50-78e66aa137ef taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.924292] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-4bbb7861-dce4-4ba4-9a50-78e66aa137ef" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.924418] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-4bbb7861-dce4-4ba4-9a50-78e66aa137ef" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.924762] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-4bbb7861-dce4-4ba4-9a50-78e66aa137ef" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.924911] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bbb7861-dce4-4ba4-9a50-78e66aa137ef',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.053625] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.427767] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.427998] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.428116] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.428413] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.428599] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.428772] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 4bbb7861-dce4-4ba4-9a50-78e66aa137ef not found, creating... [ 1016.429275] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.429817] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.429817] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.429817] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.429914] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.430172] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.430324] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.430442] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.430654] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.430788] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.430992] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 4bbb7861-dce4-4ba4-9a50-78e66aa137ef is going to be created. [ 1016.453868] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.454077] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.454163] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.454399] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.454638] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.454943] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-4bbb7861-dce4-4ba4-9a50-78e66aa137ef" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.556819] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.059865] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.060295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.060295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.060378] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.060424] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.060537] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 is going to be updated. [ 1017.127381] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.127477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.127529] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.127726] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.127873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.140117] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: IN_PROGRESS for 2s [ 1017.173601] env[70006]: INFO networking_nsxv3.common.synchronization [req-67ddc384-4490-431a-9598-3f2f62200508 req-f06daefe-c757-4234-9b9a-d1702e9bc84c service nova] Enqueued Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_rules [ 1017.174075] env[70006]: INFO networking_nsxv3.common.synchronization [req-67ddc384-4490-431a-9598-3f2f62200508 req-f06daefe-c757-4234-9b9a-d1702e9bc84c service nova] Enqueued Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_members [ 1017.174075] env[70006]: INFO networking_nsxv3.common.synchronization [req-67ddc384-4490-431a-9598-3f2f62200508 req-f06daefe-c757-4234-9b9a-d1702e9bc84c service nova] Enqueued Resource ID: 4bbb7861-dce4-4ba4-9a50-78e66aa137ef with Priority: HIGHEST for action port [ 1017.174549] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_rules [ 1017.174763] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_members [ 1017.174794] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bbb7861-dce4-4ba4-9a50-78e66aa137ef with Priority: HIGHEST for action port [ 1017.175247] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.175404] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.175515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.175774] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.175895] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.177186] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.177186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.177368] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bbb7861-dce4-4ba4-9a50-78e66aa137ef taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.177492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bbb7861-dce4-4ba4-9a50-78e66aa137ef" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.177586] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bbb7861-dce4-4ba4-9a50-78e66aa137ef" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.177827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bbb7861-dce4-4ba4-9a50-78e66aa137ef" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.178039] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bbb7861-dce4-4ba4-9a50-78e66aa137ef',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.680221] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.821152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.821152] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bbb7861-dce4-4ba4-9a50-78e66aa137ef with status ACTIVE [ 1017.821152] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.821152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.821152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.821152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.821152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.821152] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.821152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.821152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.821152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.821152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.821152] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.821152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.821152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.821152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.821152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.821943] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bbb7861-dce4-4ba4-9a50-78e66aa137ef is going to be updated. [ 1017.821943] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.821943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.821943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.821943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.821943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.821943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bbb7861-dce4-4ba4-9a50-78e66aa137ef" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.138494] env[70006]: INFO networking_nsxv3.common.synchronization [req-9e284abd-6e6c-449c-b2bf-0bc05a1b2d67 req-b210af4a-b054-4839-b1fe-f323421c1251 tempest-ServerActionsTestJSON-71305913 tempest-ServerActionsTestJSON-71305913-project-member] Enqueued Resource ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 with Priority: HIGHEST for action security_group_members [ 1018.139115] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 with Priority: HIGHEST for action security_group_members [ 1018.139479] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-15b2f848-e9f8-46b8-b9dc-b82509a3b126 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.139652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.139750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.140063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.140282] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.140419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.140529] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.140722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.141225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.141473] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15b2f848-e9f8-46b8-b9dc-b82509a3b126',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.569702] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-405 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.569963] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.570083] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.570393] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.570753] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.570993] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.571137] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.571405] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.571652] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.571896] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.572066] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.572190] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.572327] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.572464] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.572615] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.572736] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.594780] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.595162] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.595162] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.595298] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.595618] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-3d1c82dc-c975-4156-8d68-368f68ec3f87 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.595796] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-3d1c82dc-c975-4156-8d68-368f68ec3f87" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.595920] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-3d1c82dc-c975-4156-8d68-368f68ec3f87" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.596353] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-3d1c82dc-c975-4156-8d68-368f68ec3f87" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.596481] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d1c82dc-c975-4156-8d68-368f68ec3f87',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.644239] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.644402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.644527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.644833] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.644940] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.645215] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.645430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.645430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.645766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.645766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.645859] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 already deleted. [ 1018.645919] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.102047] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.102047] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.102047] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.102047] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.102047] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.102047] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 3d1c82dc-c975-4156-8d68-368f68ec3f87 not found, creating... [ 1019.102047] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.102486] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.102486] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.102486] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.102642] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.103020] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.103192] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.103311] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.103529] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.103660] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.103800] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 3d1c82dc-c975-4156-8d68-368f68ec3f87 is going to be created. [ 1019.126451] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.126673] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.126806] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.127147] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.127391] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.127623] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-3d1c82dc-c975-4156-8d68-368f68ec3f87" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.149435] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: IN_PROGRESS for 4s [ 1019.964347] env[70006]: INFO networking_nsxv3.common.synchronization [req-9e284abd-6e6c-449c-b2bf-0bc05a1b2d67 req-8b9c5aa5-90f8-4ce8-83c9-1551bb44a5fa service nova] Enqueued Resource ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 with Priority: HIGHEST for action security_group_rules [ 1019.964573] env[70006]: INFO networking_nsxv3.common.synchronization [req-9e284abd-6e6c-449c-b2bf-0bc05a1b2d67 req-8b9c5aa5-90f8-4ce8-83c9-1551bb44a5fa service nova] Enqueued Resource ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 with Priority: HIGHEST for action security_group_members [ 1019.964716] env[70006]: INFO networking_nsxv3.common.synchronization [req-9e284abd-6e6c-449c-b2bf-0bc05a1b2d67 req-8b9c5aa5-90f8-4ce8-83c9-1551bb44a5fa service nova] Enqueued Resource ID: 3d1c82dc-c975-4156-8d68-368f68ec3f87 with Priority: HIGHEST for action port [ 1019.964950] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 with Priority: HIGHEST for action security_group_rules [ 1019.965182] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 with Priority: HIGHEST for action security_group_members [ 1019.965289] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d1c82dc-c975-4156-8d68-368f68ec3f87 with Priority: HIGHEST for action port [ 1019.965932] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.966559] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.966559] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.966559] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.966559] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15b2f848-e9f8-46b8-b9dc-b82509a3b126',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.967505] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-15b2f848-e9f8-46b8-b9dc-b82509a3b126 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.967590] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.967638] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.967813] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.967976] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.968088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.968155] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.968299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.968384] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.968475] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15b2f848-e9f8-46b8-b9dc-b82509a3b126',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.969292] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d1c82dc-c975-4156-8d68-368f68ec3f87 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.969446] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d1c82dc-c975-4156-8d68-368f68ec3f87" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.969522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d1c82dc-c975-4156-8d68-368f68ec3f87" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.969710] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d1c82dc-c975-4156-8d68-368f68ec3f87" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.969812] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d1c82dc-c975-4156-8d68-368f68ec3f87',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.471310] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15b2f848-e9f8-46b8-b9dc-b82509a3b126',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.472636] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-15b2f848-e9f8-46b8-b9dc-b82509a3b126 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.472810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.473316] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d1c82dc-c975-4156-8d68-368f68ec3f87 with status ACTIVE [ 1020.473853] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.473997] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.474084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.474294] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.474384] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.474841] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.474952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.475037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.475206] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.475283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.475471] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.475585] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.475643] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.475754] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.475829] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.475913] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d1c82dc-c975-4156-8d68-368f68ec3f87 is going to be updated. [ 1020.496825] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.496953] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.497043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.497300] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.497442] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.497611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d1c82dc-c975-4156-8d68-368f68ec3f87" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.647290] env[70006]: INFO networking_nsxv3.common.synchronization [req-4b5dd892-da0c-47e7-96ba-be93e4d747b1 req-cb6d963d-ffe6-4a1d-bb4c-67ba135313bd tempest-ServersTestMultiNic-1235703585 tempest-ServersTestMultiNic-1235703585-project-member] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 1020.647889] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 1020.648324] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.649043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.649043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.649043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.649043] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.649329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.649329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.650680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.650680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.650680] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.974357] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15b2f848-e9f8-46b8-b9dc-b82509a3b126',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.019746] env[70006]: INFO networking_nsxv3.common.synchronization [req-4b5dd892-da0c-47e7-96ba-be93e4d747b1 req-df967680-c9c1-4b23-b36e-be4e69b0d623 tempest-ServersTestMultiNic-1235703585 tempest-ServersTestMultiNic-1235703585-project-member] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 1021.020181] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 1021.022615] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.022615] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.154025] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.154179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.154249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.154503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.164832] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: SUCCESS [ 1021.164832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.164832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.164832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.165197] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.165197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.165197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.165388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.165388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.165486] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.183408] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.183656] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.183801] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.183950] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.184131] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.184238] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.184352] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be updated. [ 1021.227542] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.227710] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.227756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.227961] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.228150] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.238590] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 1021.463563] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-870 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.463785] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-870" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.463918] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-870" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.464338] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-870" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.464614] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.464775] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.464899] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.465150] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.465302] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.465512] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1021.465634] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.465737] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.465847] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.465961] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1021.466084] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.466217] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.476680] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.476919] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.476919] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.477059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.477149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.477242] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 is going to be created. [ 1021.485440] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.485643] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1021.485790] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.485970] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-870" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.486337] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-ebcb7b3a-3c04-471a-b585-af59dfa574f3 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.486520] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-ebcb7b3a-3c04-471a-b585-af59dfa574f3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.486647] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-ebcb7b3a-3c04-471a-b585-af59dfa574f3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.486996] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-ebcb7b3a-3c04-471a-b585-af59dfa574f3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.487160] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebcb7b3a-3c04-471a-b585-af59dfa574f3',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.500943] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.501172] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.501238] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.501394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.501549] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.511060] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 in Status: UNINITIALIZED for 2s [ 1021.667508] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.991602] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.992554] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.992554] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.992554] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.992731] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.992765] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port ebcb7b3a-3c04-471a-b585-af59dfa574f3 not found, creating... [ 1021.994035] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.994035] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.994035] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.994035] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.994035] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.994292] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.994391] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.994520] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.994747] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.995131] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.995131] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: ebcb7b3a-3c04-471a-b585-af59dfa574f3 is going to be created. [ 1022.034027] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.034027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.034027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.034027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.034027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.034360] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-ebcb7b3a-3c04-471a-b585-af59dfa574f3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.170278] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.673040] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.673366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.673366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.673543] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.673636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.673727] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 is going to be updated. [ 1022.704428] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.704599] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.704651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.704840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.704993] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.714373] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: IN_PROGRESS for 2s [ 1022.728288] env[70006]: INFO networking_nsxv3.common.synchronization [req-4b5dd892-da0c-47e7-96ba-be93e4d747b1 req-548b571d-27b0-4911-b1f9-ead5a9ded4d4 service nova] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_rules [ 1022.728510] env[70006]: INFO networking_nsxv3.common.synchronization [req-4b5dd892-da0c-47e7-96ba-be93e4d747b1 req-548b571d-27b0-4911-b1f9-ead5a9ded4d4 service nova] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 1022.728686] env[70006]: INFO networking_nsxv3.common.synchronization [req-4b5dd892-da0c-47e7-96ba-be93e4d747b1 req-548b571d-27b0-4911-b1f9-ead5a9ded4d4 service nova] Enqueued Resource ID: ebcb7b3a-3c04-471a-b585-af59dfa574f3 with Priority: HIGHEST for action port [ 1022.729215] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_rules [ 1022.729350] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 1022.729498] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebcb7b3a-3c04-471a-b585-af59dfa574f3 with Priority: HIGHEST for action port [ 1022.729759] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.729884] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.729984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.730186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.730269] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.731180] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.731251] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.731449] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebcb7b3a-3c04-471a-b585-af59dfa574f3 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.731546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebcb7b3a-3c04-471a-b585-af59dfa574f3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.731611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebcb7b3a-3c04-471a-b585-af59dfa574f3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.731800] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebcb7b3a-3c04-471a-b585-af59dfa574f3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.731900] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebcb7b3a-3c04-471a-b585-af59dfa574f3',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.234348] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.234484] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.234682] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebcb7b3a-3c04-471a-b585-af59dfa574f3 with status ACTIVE [ 1023.234850] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.234951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.235029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.235250] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.236325] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.236325] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.236325] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.236325] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.236325] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.236325] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.236325] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.236325] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.236325] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.236677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.236677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.236677] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebcb7b3a-3c04-471a-b585-af59dfa574f3 is going to be updated. [ 1023.250000] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 1023.250449] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 deletion is rescheduled due to dependency. [ 1023.250449] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.250664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.250801] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.251031] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.251171] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.251240] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.251407] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.251514] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.251586] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.261030] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.261181] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.261249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.262020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.262020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.262020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebcb7b3a-3c04-471a-b585-af59dfa574f3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.523996] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 in Status: SUCCESS [ 1023.523996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.523996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.523996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.523996] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.523996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.523996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.523996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.523996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.523996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.525018] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15b2f848-e9f8-46b8-b9dc-b82509a3b126',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.739030] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-563 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.739538] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-563" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.739538] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-563" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.742963] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-563" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.742963] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.742963] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.742963] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.742963] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.742963] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.742963] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1023.742963] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.742963] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.742963] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.742963] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1023.742963] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.742963] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.754429] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.768164] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.768346] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1023.768493] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.769170] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-563" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.769539] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-96be8274-aa70-44e5-8a0c-84ad7d0f9737 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.769974] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-96be8274-aa70-44e5-8a0c-84ad7d0f9737" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.769974] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-96be8274-aa70-44e5-8a0c-84ad7d0f9737" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.774021] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-96be8274-aa70-44e5-8a0c-84ad7d0f9737" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.774021] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96be8274-aa70-44e5-8a0c-84ad7d0f9737',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.030031] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15b2f848-e9f8-46b8-b9dc-b82509a3b126',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.256401] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.274992] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.276062] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.276240] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.276559] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.276808] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.276891] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 96be8274-aa70-44e5-8a0c-84ad7d0f9737 not found, creating... [ 1024.277211] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.277401] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.277527] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.277763] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.277903] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.278214] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.278379] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.278500] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.278713] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.279050] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.279227] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 96be8274-aa70-44e5-8a0c-84ad7d0f9737 is going to be created. [ 1024.301638] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.301638] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.301638] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.302039] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.302039] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.302636] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-96be8274-aa70-44e5-8a0c-84ad7d0f9737" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.534896] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15b2f848-e9f8-46b8-b9dc-b82509a3b126: rpc.has_security_group_logging(os_id): False [ 1024.557641] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.558097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.558361] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.558743] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.558969] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.559366] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.559504] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.559664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.560007] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.560150] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.560276] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 is going to be created. [ 1024.639018] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.639018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.639018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.639018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.639338] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.654245] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 in Status: IN_PROGRESS for 2s [ 1024.733117] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: SUCCESS [ 1024.733117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.733117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.733117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.733117] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.733117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.733117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.733664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.733664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.733664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.733664] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.759045] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.760088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.760088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.760088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.760088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.760088] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be updated. [ 1024.801698] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.802402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.802402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.802402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.802555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.813018] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 1025.038492] env[70006]: INFO networking_nsxv3.common.synchronization [req-4b5dd892-da0c-47e7-96ba-be93e4d747b1 req-b8a9019f-a046-4272-9d6d-bdd8bfa6ac20 service nova] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_rules [ 1025.038790] env[70006]: INFO networking_nsxv3.common.synchronization [req-4b5dd892-da0c-47e7-96ba-be93e4d747b1 req-b8a9019f-a046-4272-9d6d-bdd8bfa6ac20 service nova] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 1025.038962] env[70006]: INFO networking_nsxv3.common.synchronization [req-4b5dd892-da0c-47e7-96ba-be93e4d747b1 req-b8a9019f-a046-4272-9d6d-bdd8bfa6ac20 service nova] Enqueued Resource ID: 96be8274-aa70-44e5-8a0c-84ad7d0f9737 with Priority: HIGHEST for action port [ 1025.039616] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_rules [ 1025.042519] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 1025.042787] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96be8274-aa70-44e5-8a0c-84ad7d0f9737 with Priority: HIGHEST for action port [ 1025.042928] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.043049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.043827] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.043827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.044220] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-96be8274-aa70-44e5-8a0c-84ad7d0f9737 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.044220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96be8274-aa70-44e5-8a0c-84ad7d0f9737" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.044220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96be8274-aa70-44e5-8a0c-84ad7d0f9737" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.044494] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96be8274-aa70-44e5-8a0c-84ad7d0f9737" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.046849] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96be8274-aa70-44e5-8a0c-84ad7d0f9737',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.237861] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.238070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.238149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.238373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.238551] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.238651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.238714] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.239036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.239158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.239263] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.239434] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.239578] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.239611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.239750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.239894] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.239989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.240067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.240241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.240301] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.240385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.240481] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.586073] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96be8274-aa70-44e5-8a0c-84ad7d0f9737 with status ACTIVE [ 1025.586073] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.586073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.586073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.586073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.586073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.586073] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.586073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.586073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.586073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.586073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.586073] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.586073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.586073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.586073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.586073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.586073] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96be8274-aa70-44e5-8a0c-84ad7d0f9737 is going to be updated. [ 1025.618211] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.618473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.618473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.618699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.619301] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.619663] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96be8274-aa70-44e5-8a0c-84ad7d0f9737" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.682024] env[70006]: INFO networking_nsxv3.common.synchronization [req-b998c6e0-6519-44dc-96da-793fda77b35f req-79d2ee31-c304-472b-b21c-76df3e70b563 tempest-ServersTestJSON-1431904245 tempest-ServersTestJSON-1431904245-project-member] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1025.682473] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1025.682809] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.683065] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.683130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.683484] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.683629] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.683683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.683832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.683890] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.684552] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.684552] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.744198] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85d75a9b-90ae-4f22-b7a1-48280a25caf8: rpc.has_security_group_logging(os_id): False [ 1025.764534] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.765125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.765125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.765125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.765125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.765306] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.765444] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.765444] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.765620] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.765674] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.765823] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.765919] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.765983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.766142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.766251] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.766421] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.766536] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.766710] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.766710] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.766827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.766871] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 is going to be updated. [ 1025.853495] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.853495] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.853495] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.853495] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.853495] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.881558] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: IN_PROGRESS for 2s [ 1026.140386] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.140577] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.140700] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.140981] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.141255] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.141403] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.141520] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.141741] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.141884] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.142138] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.142253] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.142364] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.142470] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.142579] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.142687] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.142824] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.163669] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.163833] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1026.163970] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.165018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.165018] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-b3de0526-9f74-4f2b-9519-cdb229f128dd taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.165018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-b3de0526-9f74-4f2b-9519-cdb229f128dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.165018] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-b3de0526-9f74-4f2b-9519-cdb229f128dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.165301] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-b3de0526-9f74-4f2b-9519-cdb229f128dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.165362] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3de0526-9f74-4f2b-9519-cdb229f128dd',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.189339] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.667418] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.667655] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.667787] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.668121] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.668282] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.668439] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port b3de0526-9f74-4f2b-9519-cdb229f128dd not found, creating... [ 1026.668710] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.668895] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.669037] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.669274] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.669413] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.669760] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.669959] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.670123] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.670404] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.670548] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.670693] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: b3de0526-9f74-4f2b-9519-cdb229f128dd is going to be created. [ 1026.672495] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 in Status: SUCCESS [ 1026.672686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.690670] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.693265] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.693527] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.693664] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.693948] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.694224] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.694435] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-b3de0526-9f74-4f2b-9519-cdb229f128dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.826475] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 1026.826727] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.826926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.827170] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.827400] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.827982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.827982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.827982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.827982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.828315] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.158774] env[70006]: INFO networking_nsxv3.common.synchronization [req-a1640009-325c-41c5-92a3-3622a846938a req-68132752-4016-4613-b876-f5d52e29cd0c tempest-ServersNegativeTestJSON-161729029 tempest-ServersNegativeTestJSON-161729029-project-member] Enqueued Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_members [ 1027.162904] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_members [ 1027.163417] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.163593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.163693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.163957] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.164177] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.164323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.164413] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.164610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.164721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.164841] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.196335] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.196535] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.196581] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.196769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.196853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.196950] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 1027.233568] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.233847] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.233847] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.234037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.234168] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.247550] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 1027.331300] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.667449] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.726678] env[70006]: INFO networking_nsxv3.common.synchronization [req-b998c6e0-6519-44dc-96da-793fda77b35f req-20a7faac-edf0-4710-9d0a-c8c293a8b89b service nova] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_rules [ 1027.726874] env[70006]: INFO networking_nsxv3.common.synchronization [req-b998c6e0-6519-44dc-96da-793fda77b35f req-20a7faac-edf0-4710-9d0a-c8c293a8b89b service nova] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1027.727011] env[70006]: INFO networking_nsxv3.common.synchronization [req-b998c6e0-6519-44dc-96da-793fda77b35f req-20a7faac-edf0-4710-9d0a-c8c293a8b89b service nova] Enqueued Resource ID: b3de0526-9f74-4f2b-9519-cdb229f128dd with Priority: HIGHEST for action port [ 1027.727256] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_rules [ 1027.727384] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1027.727478] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3de0526-9f74-4f2b-9519-cdb229f128dd with Priority: HIGHEST for action port [ 1027.733712] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.733712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.733712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.733712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.733712] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.733712] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.733712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.733712] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3de0526-9f74-4f2b-9519-cdb229f128dd taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.733712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3de0526-9f74-4f2b-9519-cdb229f128dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.733712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3de0526-9f74-4f2b-9519-cdb229f128dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.733712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3de0526-9f74-4f2b-9519-cdb229f128dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.733712] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3de0526-9f74-4f2b-9519-cdb229f128dd',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.833988] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.896064] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: SUCCESS [ 1027.896911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.170111] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.239114] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.239355] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.239605] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3de0526-9f74-4f2b-9519-cdb229f128dd with status ACTIVE [ 1028.239880] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.241328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.241463] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.241756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.241988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.242216] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.242430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.242491] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.242718] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.242845] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.248497] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.248497] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.248497] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.248497] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.248497] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.248497] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3de0526-9f74-4f2b-9519-cdb229f128dd is going to be updated. [ 1028.278505] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.278678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.278743] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.278944] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.279105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.279288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3de0526-9f74-4f2b-9519-cdb229f128dd" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.336557] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.336858] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.336858] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.337248] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.337248] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.337248] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be updated. [ 1028.375603] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.376777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.376777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.377179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.377297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.394362] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 1028.673127] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.673310] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.673395] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.673585] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.673987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.673987] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 is going to be updated. [ 1028.702432] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.702596] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.702649] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.702853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.702995] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.713470] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: IN_PROGRESS for 2s [ 1029.259759] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 1029.260071] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.260170] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.260396] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.260591] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.260710] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.260779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.260978] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.261101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.261199] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.763748] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.265896] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.412164] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 1030.412473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.412781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.413069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.413365] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.413544] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.413617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.413807] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.413902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.414010] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.414132] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.418323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.418382] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.418584] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.418706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.418865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.419040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.419143] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.419248] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.725089] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: SUCCESS [ 1030.725341] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.768214] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.771798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.771798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.771798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.771798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.771798] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 1030.802700] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.802700] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.802700] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.802700] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.802700] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.812358] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 1030.921505] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.921625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.923056] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.426603] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.932741] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.932818] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.933236] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.933236] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.933236] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.933440] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be updated. [ 1031.970098] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.970317] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.970317] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.970537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.970682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.982914] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 1032.729148] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1032.729692] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 1032.823976] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 1032.824226] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.824403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.824622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.824814] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.825198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.825293] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.825512] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.825611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.825705] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.825806] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.328347] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.328612] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.328701] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.328937] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.329507] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.329633] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.329705] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.329865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.329954] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.330055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.330215] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.330307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.330381] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.330527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.330665] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.330757] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.330823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.330983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.331251] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.331346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.331542] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.837058] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b2723f9-b1dc-419e-b339-13aae985829f: rpc.has_security_group_logging(os_id): False [ 1033.857123] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.857350] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.857407] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.857694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.857827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.858154] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.858309] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.858404] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.858849] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.858849] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.859073] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.859190] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.859287] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.859492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.859604] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.859889] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.860099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.860173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.860339] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.860454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.860580] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 1033.948473] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.948745] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.949045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.949410] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.949680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.973272] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 1033.996127] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 1033.996811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.996811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.997041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.997302] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.997511] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.997594] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.997802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.998025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.998099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.998274] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.998397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.998604] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.998785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.998920] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.999128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.999262] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.999473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.000266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.000266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.000266] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.503037] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5bdfda1-5bdc-410b-ab38-e2b0315faa59: rpc.has_security_group_logging(os_id): False [ 1034.521606] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.521755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.521822] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.522121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.523029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.523029] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.523029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.523029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.523029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.523029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.523029] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.523351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.523351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.523351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.523429] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.523960] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.523960] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.523960] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.523960] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.523960] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.523960] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be updated. [ 1034.589015] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.589194] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.589266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.589499] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.589651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.607232] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 1035.181852] env[70006]: INFO networking_nsxv3.common.synchronization [req-abbc5eaa-1b24-4de2-a146-35702f406e35 req-f1afb018-4098-4b01-9d07-7af12a9b6dc3 tempest-ListServerFiltersTestJSON-2066587110 tempest-ListServerFiltersTestJSON-2066587110-project-member] Enqueued Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 1035.182784] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 1035.182784] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.182898] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.182939] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.183700] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.183891] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.184032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.184753] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.184929] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.185032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.185138] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.688085] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.989155] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 1035.989701] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.190388] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.627336] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 1036.627873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.628142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.628453] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.628605] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.693877] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.693877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.693877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.694179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.694235] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.694386] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152fa45c-61d1-4b26-872b-ee9494b58bea is going to be updated. [ 1036.727716] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.727878] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.727921] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.728203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.728361] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.739354] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: IN_PROGRESS for 2s [ 1037.133170] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.133526] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.133725] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.133782] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.133962] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.134122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.134172] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.134309] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.134413] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.134504] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.134606] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.637530] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.638090] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.638090] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.638220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.638442] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.638607] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.638733] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.638962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.639129] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.639232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.639435] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.639567] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.639649] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.639840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.641830] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.641830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.641830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.641830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.641830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.641830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.641830] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.987987] env[70006]: INFO networking_nsxv3.common.synchronization [req-ede2ff6b-8677-415c-8211-eebf504ae878 req-8ee9ac4f-5cb3-467f-96d5-890092aa501f tempest-ServersTestMultiNic-1235703585 tempest-ServersTestMultiNic-1235703585-project-member] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 1037.989528] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 1037.989528] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.989738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.990324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.991311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.991311] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.991311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.991311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.991636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.991636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.991805] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.146643] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5bdfda1-5bdc-410b-ab38-e2b0315faa59: rpc.has_security_group_logging(os_id): False [ 1038.164731] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.164910] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.164951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.165185] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.165275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.165484] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.165580] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.165650] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.165779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.165853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.166113] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.166205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.166205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.166344] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.166717] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.166992] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.167057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.167137] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.167243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.167316] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.167401] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be updated. [ 1038.239570] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.239729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.239814] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.240031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.240187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.258702] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 1038.291830] env[70006]: INFO networking_nsxv3.common.synchronization [req-ede2ff6b-8677-415c-8211-eebf504ae878 req-46e41d26-51b5-48f8-995b-4e3fe3367963 tempest-ServersTestMultiNic-1235703585 tempest-ServersTestMultiNic-1235703585-project-member] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 1038.293973] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGHEST for action security_group_members [ 1038.294440] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.294521] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.496089] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.704779] env[70006]: INFO networking_nsxv3.common.synchronization [req-87c5bfe3-23ea-4bf6-a819-b1c48dbebe64 req-1c80b4c7-38b4-4f9a-928e-fa2c2ccae274 tempest-ServersTestJSON-1431904245 tempest-ServersTestJSON-1431904245-project-member] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1038.705373] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1038.705681] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.705829] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.706759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.706759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.706759] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.706759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.706759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.706759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.706759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.707051] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.749466] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: SUCCESS [ 1038.749902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.998171] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.211862] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.500492] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.500665] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.500779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.500943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.501132] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.501250] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be updated. [ 1039.532656] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.532812] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.532870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.533088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.533227] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.546621] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 1039.714346] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.218811] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.218811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.218811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.218811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.218811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.218811] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 1040.250315] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.250453] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.250519] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.250727] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.250867] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.268886] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 1040.284231] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 1040.284464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.482468] env[70006]: INFO networking_nsxv3.common.synchronization [None req-97efb546-57f2-4d04-a7d0-8bdb360633f8 None None] Enqueued Resource ID: a40714ef-e6ec-4514-bf07-c366e9a01548 with Priority: HIGHEST for action port [ 1040.485148] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a40714ef-e6ec-4514-bf07-c366e9a01548 with Priority: HIGHEST for action port [ 1040.485605] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-a40714ef-e6ec-4514-bf07-c366e9a01548 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.488323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a40714ef-e6ec-4514-bf07-c366e9a01548" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.488396] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a40714ef-e6ec-4514-bf07-c366e9a01548" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.488809] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a40714ef-e6ec-4514-bf07-c366e9a01548" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.488809] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a40714ef-e6ec-4514-bf07-c366e9a01548',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.991378] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a40714ef-e6ec-4514-bf07-c366e9a01548 [ 1040.991378] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.991738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.991738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.992322] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.992438] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.992519] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a40714ef-e6ec-4514-bf07-c366e9a01548 already deleted. [ 1040.992600] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a40714ef-e6ec-4514-bf07-c366e9a01548" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.093793] env[70006]: INFO networking_nsxv3.common.synchronization [req-4dd7ddc3-7c22-4edc-bed7-940f13c203c7 req-3ed76959-6d5b-450c-8c96-2ebf21ea6561 tempest-ServersTestBootFromVolume-1562632258 tempest-ServersTestBootFromVolume-1562632258-project-member] Enqueued Resource ID: ec4d7bd2-dee8-4667-8923-366f583eec53 with Priority: HIGHEST for action security_group_members [ 1041.095246] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4d7bd2-dee8-4667-8923-366f583eec53 with Priority: HIGHEST for action security_group_members [ 1041.095246] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec4d7bd2-dee8-4667-8923-366f583eec53 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.095246] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.095246] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.095498] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.095498] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.095584] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.095584] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.095984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.096089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.096188] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec4d7bd2-dee8-4667-8923-366f583eec53',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.457854] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.458102] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-877" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.458242] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-877" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.458949] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-877" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.459279] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.459468] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.459596] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.459838] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.459988] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.460336] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.460468] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.460588] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.460705] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.460822] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.460933] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.461471] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.491148] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.491148] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1041.491148] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.491148] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-877" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.491148] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-e56ae4d8-5c16-4511-84c0-9c50ce3fa345 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.491148] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-e56ae4d8-5c16-4511-84c0-9c50ce3fa345" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.491148] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-e56ae4d8-5c16-4511-84c0-9c50ce3fa345" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.491148] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-e56ae4d8-5c16-4511-84c0-9c50ce3fa345" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.492191] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e56ae4d8-5c16-4511-84c0-9c50ce3fa345',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.559785] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 1041.561600] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.562080] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.562297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.562830] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.562830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.562830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.562830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.563042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.563042] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.598732] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.598844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.598844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.599134] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.599211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.599375] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.599480] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.599542] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.599706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.599783] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.599869] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec4d7bd2-dee8-4667-8923-366f583eec53 already deleted. [ 1041.600450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.996985] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.996985] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.996985] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.996985] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.997426] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.997426] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port e56ae4d8-5c16-4511-84c0-9c50ce3fa345 not found, creating... [ 1041.997490] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.997646] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.997771] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.998708] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.998708] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.998708] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.998708] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.998708] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.998959] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.999088] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.999250] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: e56ae4d8-5c16-4511-84c0-9c50ce3fa345 is going to be created. [ 1042.027544] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.027776] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.027906] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.028220] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.028463] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.028700] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-e56ae4d8-5c16-4511-84c0-9c50ce3fa345" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.065354] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.065534] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.065610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.065830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.065928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.066145] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.066247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.066310] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.066497] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.066613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.066711] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be updated. [ 1042.095412] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.095594] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.095742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.095882] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.096043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.112216] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: IN_PROGRESS for 2s [ 1042.282040] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 1042.282040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.948085] env[70006]: INFO networking_nsxv3.common.synchronization [req-4dd7ddc3-7c22-4edc-bed7-940f13c203c7 req-2c9137c0-654f-4502-bf83-2a78a0a176c4 service nova] Enqueued Resource ID: ec4d7bd2-dee8-4667-8923-366f583eec53 with Priority: HIGHEST for action security_group_rules [ 1042.948085] env[70006]: INFO networking_nsxv3.common.synchronization [req-4dd7ddc3-7c22-4edc-bed7-940f13c203c7 req-2c9137c0-654f-4502-bf83-2a78a0a176c4 service nova] Enqueued Resource ID: ec4d7bd2-dee8-4667-8923-366f583eec53 with Priority: HIGHEST for action security_group_members [ 1042.948085] env[70006]: INFO networking_nsxv3.common.synchronization [req-4dd7ddc3-7c22-4edc-bed7-940f13c203c7 req-2c9137c0-654f-4502-bf83-2a78a0a176c4 service nova] Enqueued Resource ID: e56ae4d8-5c16-4511-84c0-9c50ce3fa345 with Priority: HIGHEST for action port [ 1042.948569] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4d7bd2-dee8-4667-8923-366f583eec53 with Priority: HIGHEST for action security_group_rules [ 1042.948745] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4d7bd2-dee8-4667-8923-366f583eec53 with Priority: HIGHEST for action security_group_members [ 1042.948796] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56ae4d8-5c16-4511-84c0-9c50ce3fa345 with Priority: HIGHEST for action port [ 1042.949775] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec4d7bd2-dee8-4667-8923-366f583eec53 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.950168] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.950900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.951263] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.951464] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec4d7bd2-dee8-4667-8923-366f583eec53',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.953082] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec4d7bd2-dee8-4667-8923-366f583eec53 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.954238] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.954311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.954520] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.954692] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.954795] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.954857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.955031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.955118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.955214] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec4d7bd2-dee8-4667-8923-366f583eec53',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.956154] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-e56ae4d8-5c16-4511-84c0-9c50ce3fa345 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.956299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e56ae4d8-5c16-4511-84c0-9c50ce3fa345" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.956370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e56ae4d8-5c16-4511-84c0-9c50ce3fa345" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.956528] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e56ae4d8-5c16-4511-84c0-9c50ce3fa345" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.956601] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e56ae4d8-5c16-4511-84c0-9c50ce3fa345',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.098337] env[70006]: INFO networking_nsxv3.common.synchronization [None req-f6a1f6e5-4262-472a-9f23-f6a14466fc22 None None] Enqueued Resource ID: c65e036b-927f-4db8-988a-83d4ea9ce14d with Priority: HIGHEST for action port [ 1043.098337] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c65e036b-927f-4db8-988a-83d4ea9ce14d with Priority: HIGHEST for action port [ 1043.099447] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-c65e036b-927f-4db8-988a-83d4ea9ce14d taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.099447] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c65e036b-927f-4db8-988a-83d4ea9ce14d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.099447] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c65e036b-927f-4db8-988a-83d4ea9ce14d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.099791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c65e036b-927f-4db8-988a-83d4ea9ce14d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.099883] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c65e036b-927f-4db8-988a-83d4ea9ce14d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.458929] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec4d7bd2-dee8-4667-8923-366f583eec53 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.459142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.459285] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec4d7bd2-dee8-4667-8923-366f583eec53',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.461954] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e56ae4d8-5c16-4511-84c0-9c50ce3fa345 with status ACTIVE [ 1043.462222] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.462332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.462401] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.462598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.462689] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.462864] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.462968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.463085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.463180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.463259] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.463464] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.463564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.463826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.463826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.463826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.463979] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e56ae4d8-5c16-4511-84c0-9c50ce3fa345 is going to be updated. [ 1043.486431] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.486645] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.486645] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.486913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.486913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.487085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e56ae4d8-5c16-4511-84c0-9c50ce3fa345" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.602017] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c65e036b-927f-4db8-988a-83d4ea9ce14d [ 1043.602423] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.602738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.602738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.602898] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.602952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.603053] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c65e036b-927f-4db8-988a-83d4ea9ce14d already deleted. [ 1043.603150] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c65e036b-927f-4db8-988a-83d4ea9ce14d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.833941] env[70006]: INFO networking_nsxv3.common.synchronization [None req-15b60a3e-5f29-42eb-9576-5bd773b27580 None None] Enqueued Resource ID: 5901df5f-6f7d-4799-b597-7b2c9862ecd6 with Priority: HIGHEST for action port [ 1043.837652] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5901df5f-6f7d-4799-b597-7b2c9862ecd6 with Priority: HIGHEST for action port [ 1043.837848] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-5901df5f-6f7d-4799-b597-7b2c9862ecd6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.837971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5901df5f-6f7d-4799-b597-7b2c9862ecd6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.838036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5901df5f-6f7d-4799-b597-7b2c9862ecd6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.838265] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5901df5f-6f7d-4799-b597-7b2c9862ecd6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.838352] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5901df5f-6f7d-4799-b597-7b2c9862ecd6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.962071] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec4d7bd2-dee8-4667-8923-366f583eec53',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.077243] env[70006]: INFO networking_nsxv3.common.synchronization [req-7e72d1c7-4af9-4fe8-978a-78a31bba7450 req-bdb2b3e2-6d13-4242-a097-28ed8b85281a tempest-AttachInterfacesUnderV243Test-1270413728 tempest-AttachInterfacesUnderV243Test-1270413728-project-member] Enqueued Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_members [ 1044.077767] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_members [ 1044.078083] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e260dc20-0003-47f6-b50c-1cb4b48cdd79 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.078210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.078276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.078525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.078679] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.078771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.078833] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.078981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.081704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.081820] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.122795] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 in Status: SUCCESS [ 1044.123712] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 deletion is rescheduled due to dependency. [ 1044.123712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.341211] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5901df5f-6f7d-4799-b597-7b2c9862ecd6 [ 1044.341570] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.341668] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.341668] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.341879] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.341972] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.342080] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5901df5f-6f7d-4799-b597-7b2c9862ecd6 already deleted. [ 1044.342165] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5901df5f-6f7d-4799-b597-7b2c9862ecd6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.465557] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.465832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.465832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.466609] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.466609] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.466609] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec4d7bd2-dee8-4667-8923-366f583eec53 is going to be created. [ 1044.499362] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.499596] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.499641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.499834] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.502262] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.510177] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec4d7bd2-dee8-4667-8923-366f583eec53 in Status: UNINITIALIZED for 2s [ 1044.587973] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.587973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.587973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.587973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.587973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.587973] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.587973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.587973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.587973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.587973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.587973] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 already deleted. [ 1044.587973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.685216] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.685387] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-656" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.685479] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-656" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.685816] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-656" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.686366] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.686366] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.686542] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.686607] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.686760] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.686974] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.687105] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.687219] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.687329] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.687445] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.687556] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.687693] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.708042] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.708232] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1044.708393] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.708541] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-656" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.708870] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-38ceae0a-4242-4587-9200-5cb36bbb5814 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.709124] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.709262] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.709577] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.709720] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38ceae0a-4242-4587-9200-5cb36bbb5814',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.212410] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.212803] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.212846] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.213135] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.213339] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.213505] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 38ceae0a-4242-4587-9200-5cb36bbb5814 not found, creating... [ 1045.213781] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.213946] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.214087] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.214466] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.214546] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.214915] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.215150] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.215295] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.215552] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.215711] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.215860] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 38ceae0a-4242-4587-9200-5cb36bbb5814 is going to be created. [ 1045.250998] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.251508] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.251646] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.251932] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.252347] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.252608] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.339056] env[70006]: INFO networking_nsxv3.common.synchronization [None req-c0bb903b-f5af-4ef5-95e9-cff5e5d65259 tempest-ServersTestFqdnHostnames-1659575620 tempest-ServersTestFqdnHostnames-1659575620-project-member] Enqueued Resource ID: beef0235-0372-4fe8-a0e3-e4255271d6ce with Priority: HIGHEST for action security_group_rules [ 1045.339653] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beef0235-0372-4fe8-a0e3-e4255271d6ce with Priority: HIGHEST for action security_group_rules [ 1045.339962] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-beef0235-0372-4fe8-a0e3-e4255271d6ce taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.340107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.340182] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.340441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.340524] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('beef0235-0372-4fe8-a0e3-e4255271d6ce',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.429736] env[70006]: INFO networking_nsxv3.common.synchronization [None req-7c79f722-6918-4015-884a-77f69b7899fd tempest-ServersTestFqdnHostnames-1659575620 tempest-ServersTestFqdnHostnames-1659575620-project-member] Enqueued Resource ID: beef0235-0372-4fe8-a0e3-e4255271d6ce with Priority: HIGHEST for action security_group_rules [ 1045.430220] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beef0235-0372-4fe8-a0e3-e4255271d6ce with Priority: HIGHEST for action security_group_rules [ 1045.430529] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-beef0235-0372-4fe8-a0e3-e4255271d6ce taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.430623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.867363] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.867689] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.867689] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.867689] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.867807] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.867907] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: beef0235-0372-4fe8-a0e3-e4255271d6ce already deleted. [ 1045.868153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.868153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.868319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.868404] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('beef0235-0372-4fe8-a0e3-e4255271d6ce',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.872595] env[70006]: INFO networking_nsxv3.common.synchronization [None req-adf37ac6-6aa8-4be2-9fe8-912260c9c3ed None None] Enqueued Resource ID: 4f5836b1-7480-4066-8cf2-a0414008cbe5 with Priority: HIGHEST for action port [ 1045.872698] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5836b1-7480-4066-8cf2-a0414008cbe5 with Priority: HIGHEST for action port [ 1045.873227] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f5836b1-7480-4066-8cf2-a0414008cbe5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.873315] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f5836b1-7480-4066-8cf2-a0414008cbe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.873442] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f5836b1-7480-4066-8cf2-a0414008cbe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.873653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f5836b1-7480-4066-8cf2-a0414008cbe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.873737] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f5836b1-7480-4066-8cf2-a0414008cbe5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.999435] env[70006]: INFO networking_nsxv3.common.synchronization [req-7e72d1c7-4af9-4fe8-978a-78a31bba7450 req-e7377d01-3554-4360-9fb7-5a6f4353a8f8 service nova] Enqueued Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_rules [ 1045.999707] env[70006]: INFO networking_nsxv3.common.synchronization [req-7e72d1c7-4af9-4fe8-978a-78a31bba7450 req-e7377d01-3554-4360-9fb7-5a6f4353a8f8 service nova] Enqueued Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_members [ 1045.999904] env[70006]: INFO networking_nsxv3.common.synchronization [req-7e72d1c7-4af9-4fe8-978a-78a31bba7450 req-e7377d01-3554-4360-9fb7-5a6f4353a8f8 service nova] Enqueued Resource ID: 38ceae0a-4242-4587-9200-5cb36bbb5814 with Priority: HIGHEST for action port [ 1046.000638] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_rules [ 1046.000761] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_members [ 1046.000897] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ceae0a-4242-4587-9200-5cb36bbb5814 with Priority: HIGHEST for action port [ 1046.001434] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.001654] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.001806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.002243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.002767] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.005029] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e260dc20-0003-47f6-b50c-1cb4b48cdd79 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.007898] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.008027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.008309] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.008534] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.008952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.009114] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.009396] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.009545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.009732] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.012570] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-38ceae0a-4242-4587-9200-5cb36bbb5814 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.014252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.014434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.014731] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.014867] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38ceae0a-4242-4587-9200-5cb36bbb5814',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.318017] env[70006]: INFO networking_nsxv3.common.synchronization [req-a2d7483e-7efe-404d-9d52-8bdc08648e3e req-266ec000-6c07-4e49-965a-2a9096052aea tempest-DeleteServersTestJSON-472565240 tempest-DeleteServersTestJSON-472565240-project-member] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1046.318905] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1046.319476] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.319615] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.319721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.319962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.320257] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.320434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.320596] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.320836] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.321016] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.321194] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.376472] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f5836b1-7480-4066-8cf2-a0414008cbe5 [ 1046.376806] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.376983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.377071] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.377318] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.377416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.377533] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f5836b1-7480-4066-8cf2-a0414008cbe5 already deleted. [ 1046.377619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f5836b1-7480-4066-8cf2-a0414008cbe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.392208] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.392455] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.392536] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.392791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.392901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.393059] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: beef0235-0372-4fe8-a0e3-e4255271d6ce already deleted. [ 1046.393128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.516916] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.520373] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e260dc20-0003-47f6-b50c-1cb4b48cdd79 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.520373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.520373] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38ceae0a-4242-4587-9200-5cb36bbb5814 with status ACTIVE [ 1046.520373] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.520373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.520373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.520373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.520373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.520373] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.520373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.520373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.520373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.520373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.520373] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.520881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.520881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.520881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.520881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.520881] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38ceae0a-4242-4587-9200-5cb36bbb5814 is going to be updated. [ 1046.528034] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec4d7bd2-dee8-4667-8923-366f583eec53 in Status: SUCCESS [ 1046.528034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.528034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.528217] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.528337] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.528449] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.528517] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.528669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.528750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.528833] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.528961] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec4d7bd2-dee8-4667-8923-366f583eec53',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.550612] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.550612] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.550612] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.550995] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.550995] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.551328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.670717] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.670717] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.671277] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.672491] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.672907] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.673148] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.673492] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.674412] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.674412] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.674412] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.674412] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1046.674412] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1046.674612] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1046.674612] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.674684] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1046.674840] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1046.694329] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1046.694510] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1046.694664] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1046.694868] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.695267] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-2ac9b499-cd46-43fe-a6ca-74f684311b29 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.695489] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-2ac9b499-cd46-43fe-a6ca-74f684311b29" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.695634] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-2ac9b499-cd46-43fe-a6ca-74f684311b29" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.696036] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-2ac9b499-cd46-43fe-a6ca-74f684311b29" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.696218] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ac9b499-cd46-43fe-a6ca-74f684311b29',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.825223] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.825441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.825504] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.825707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.825805] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.826018] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.826351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.826351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.826351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.826493] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.826493] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 1046.855668] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.855838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.855916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.856144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.856286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.869193] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 1047.027405] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.033739] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec4d7bd2-dee8-4667-8923-366f583eec53',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.200055] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.200249] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.200296] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.201033] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.201033] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.201234] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 2ac9b499-cd46-43fe-a6ca-74f684311b29 not found, creating... [ 1047.201655] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.202564] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.202759] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.203779] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.203779] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.204209] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.204351] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.204524] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.204892] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.205198] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.205321] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 2ac9b499-cd46-43fe-a6ca-74f684311b29 is going to be created. [ 1047.233960] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.233960] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.234121] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.234380] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.234647] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.234892] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-2ac9b499-cd46-43fe-a6ca-74f684311b29" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.529895] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.530255] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.530255] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.530436] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.530533] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.530634] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 is going to be created. [ 1047.538706] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec4d7bd2-dee8-4667-8923-366f583eec53: rpc.has_security_group_logging(os_id): False [ 1047.559133] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.559290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.559355] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.560180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.560180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.560180] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.560180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.560180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.560415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.560415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.560415] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec4d7bd2-dee8-4667-8923-366f583eec53 is going to be created. [ 1047.563961] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.563961] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.563961] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.563961] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.563961] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.573161] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 in Status: UNINITIALIZED for 2s [ 1047.625754] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.625754] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.625754] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.625947] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.625990] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.642603] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec4d7bd2-dee8-4667-8923-366f583eec53 in Status: IN_PROGRESS for 2s [ 1048.009778] env[70006]: INFO networking_nsxv3.common.synchronization [req-a2d7483e-7efe-404d-9d52-8bdc08648e3e req-6a7c771c-86b9-4b86-bf37-1f2c5c765d2f service nova] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_rules [ 1048.009778] env[70006]: INFO networking_nsxv3.common.synchronization [req-a2d7483e-7efe-404d-9d52-8bdc08648e3e req-6a7c771c-86b9-4b86-bf37-1f2c5c765d2f service nova] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1048.009778] env[70006]: INFO networking_nsxv3.common.synchronization [req-a2d7483e-7efe-404d-9d52-8bdc08648e3e req-6a7c771c-86b9-4b86-bf37-1f2c5c765d2f service nova] Enqueued Resource ID: 2ac9b499-cd46-43fe-a6ca-74f684311b29 with Priority: HIGHEST for action port [ 1048.009778] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_rules [ 1048.009778] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1048.009933] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac9b499-cd46-43fe-a6ca-74f684311b29 with Priority: HIGHEST for action port [ 1048.011385] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.011385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.011385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.011385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.011385] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.011809] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.011895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.012049] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ac9b499-cd46-43fe-a6ca-74f684311b29 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.012166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ac9b499-cd46-43fe-a6ca-74f684311b29" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.012231] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ac9b499-cd46-43fe-a6ca-74f684311b29" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.012491] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ac9b499-cd46-43fe-a6ca-74f684311b29" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.012491] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ac9b499-cd46-43fe-a6ca-74f684311b29',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.517625] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.517625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.517625] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ac9b499-cd46-43fe-a6ca-74f684311b29 with status ACTIVE [ 1048.517625] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.517625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.517625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.517625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.517625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.517625] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.517625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.517625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.517625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.517625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.517625] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.518412] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.518412] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.518412] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.518412] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.518412] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ac9b499-cd46-43fe-a6ca-74f684311b29 is going to be updated. [ 1048.539317] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.540952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.540952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.540952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.540952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.540952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ac9b499-cd46-43fe-a6ca-74f684311b29" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.879113] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 1048.879332] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 deletion is rescheduled due to dependency. [ 1048.879453] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.879612] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.879850] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.880040] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.880158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.880212] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.880356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.880438] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.880530] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.384027] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.583827] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 in Status: SUCCESS [ 1049.584252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.584558] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.584775] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.584968] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.585090] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.585254] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.585314] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.585375] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.585450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.585547] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.658514] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec4d7bd2-dee8-4667-8923-366f583eec53 in Status: SUCCESS [ 1049.658823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.889842] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.089356] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.392472] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.392743] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.392834] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.393196] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.393356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.393824] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 1050.451801] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.452169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.452169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.452505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.452505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.466309] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 1050.590632] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e260dc20-0003-47f6-b50c-1cb4b48cdd79: rpc.has_security_group_logging(os_id): False [ 1050.610876] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.610876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.610876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.611116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.611116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.611531] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.611686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.611785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.612447] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.612651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.612843] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 is going to be created. [ 1050.691206] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.691451] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.691531] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.691770] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.692017] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.721981] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 in Status: IN_PROGRESS for 2s [ 1052.457590] env[70006]: INFO networking_nsxv3.common.synchronization [req-5120a384-43b4-42fe-ab3b-43a370934a7e req-99833dab-3f36-4787-ba9f-c60b70aee0a3 tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1052.458708] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1052.459133] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.459384] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.459384] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.459889] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.460127] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.460272] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.460359] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.460590] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.460708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.460837] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.478071] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 1052.478406] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.478755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.479059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.479222] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.479342] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.479415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.479661] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.479661] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.479773] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.479838] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.737978] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 in Status: SUCCESS [ 1052.738237] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.799202] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.799411] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.799576] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.799828] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.801533] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.801533] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.801698] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.801883] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.802055] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.802289] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1052.802919] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.802919] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.802919] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.802919] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1052.802919] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.803171] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.831645] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.831763] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1052.831896] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.832201] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.832615] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-7b19b577-689c-4e1d-bdb0-bab33f15bd8f taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.832811] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-7b19b577-689c-4e1d-bdb0-bab33f15bd8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.832943] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-7b19b577-689c-4e1d-bdb0-bab33f15bd8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.833305] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-7b19b577-689c-4e1d-bdb0-bab33f15bd8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.833485] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b19b577-689c-4e1d-bdb0-bab33f15bd8f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.963613] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.963830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.963896] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.964122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.982965] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.983195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.983235] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.983535] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.983728] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.983837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.983891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.984069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.984165] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.985063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.985063] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.985063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.985063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.985063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.985063] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.985063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.985357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.985357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.985357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.985518] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.985518] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.987203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.987590] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.987704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.988444] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.988444] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.988444] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.988444] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be updated. [ 1053.022656] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.022878] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.022990] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.023553] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.023777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.032839] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 1053.335752] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.335983] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.336117] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.336415] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.336570] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.336731] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 7b19b577-689c-4e1d-bdb0-bab33f15bd8f not found, creating... [ 1053.337028] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.337175] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.337323] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.337614] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.338084] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.338084] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.338235] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.338339] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.338556] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.338694] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.338850] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 7b19b577-689c-4e1d-bdb0-bab33f15bd8f is going to be created. [ 1053.358080] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.358080] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.358080] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.358412] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.358461] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.358688] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-7b19b577-689c-4e1d-bdb0-bab33f15bd8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.489649] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5: rpc.has_security_group_logging(os_id): False [ 1053.507842] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.507956] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.508043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.508275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.508366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.508592] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.508691] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.508757] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.508905] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.508983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.509208] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.509346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.509429] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.509500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.509615] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.509748] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.509840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.509896] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.510049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.510134] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.510215] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 1053.590908] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.591127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.591226] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.591464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.591681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.606231] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 1054.083834] env[70006]: INFO networking_nsxv3.common.synchronization [req-5120a384-43b4-42fe-ab3b-43a370934a7e req-2718da82-d561-4e12-ad06-1b36be8c649d service nova] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_rules [ 1054.084042] env[70006]: INFO networking_nsxv3.common.synchronization [req-5120a384-43b4-42fe-ab3b-43a370934a7e req-2718da82-d561-4e12-ad06-1b36be8c649d service nova] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1054.084383] env[70006]: INFO networking_nsxv3.common.synchronization [req-5120a384-43b4-42fe-ab3b-43a370934a7e req-2718da82-d561-4e12-ad06-1b36be8c649d service nova] Enqueued Resource ID: 7b19b577-689c-4e1d-bdb0-bab33f15bd8f with Priority: HIGHEST for action port [ 1054.084558] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_rules [ 1054.084743] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1054.085161] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b19b577-689c-4e1d-bdb0-bab33f15bd8f with Priority: HIGHEST for action port [ 1054.087282] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.088409] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.088409] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.090669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.090820] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.092725] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.092725] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.092937] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b19b577-689c-4e1d-bdb0-bab33f15bd8f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.093064] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b19b577-689c-4e1d-bdb0-bab33f15bd8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.093129] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b19b577-689c-4e1d-bdb0-bab33f15bd8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.093722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b19b577-689c-4e1d-bdb0-bab33f15bd8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.093722] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b19b577-689c-4e1d-bdb0-bab33f15bd8f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.596678] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.597333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.597333] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b19b577-689c-4e1d-bdb0-bab33f15bd8f with status ACTIVE [ 1054.597333] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.597333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.597333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.597660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.597660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.597794] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.597868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.597945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.598195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.598195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.598360] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.598445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.598508] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.598646] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.598733] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.598798] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b19b577-689c-4e1d-bdb0-bab33f15bd8f is going to be updated. [ 1054.622209] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.622329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.622385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.622597] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.622734] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.622900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b19b577-689c-4e1d-bdb0-bab33f15bd8f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.042660] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 1055.042846] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 deletion is rescheduled due to dependency. [ 1055.042964] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.043322] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.043366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.043570] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.043693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.043761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.043925] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.044020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.044117] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.546461] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.621609] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 1055.621934] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.050950] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.553256] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.553505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.553505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.554701] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.554701] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.554874] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be updated. [ 1056.584484] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.584681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.584681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.584909] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.585166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.594375] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 1058.390736] env[70006]: INFO networking_nsxv3.common.synchronization [req-b25ce846-f889-4ef6-a8f6-a42c287dcbca req-c47cebfd-e8ac-4c02-8ec3-4271fb640b33 tempest-ListServerFiltersTestJSON-2066587110 tempest-ListServerFiltersTestJSON-2066587110-project-member] Enqueued Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 1058.391457] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGHEST for action security_group_members [ 1058.391801] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.391934] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.392011] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.392237] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.392388] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.392482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.392545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.392689] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.392778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.392895] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.609321] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 1058.609462] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.609614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.609874] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.610170] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.610363] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.610449] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.610638] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.610728] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.610820] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.610919] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.895062] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.895235] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.895312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.895545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.895641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.896115] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.896115] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.896115] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.896270] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.896270] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.896346] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152fa45c-61d1-4b26-872b-ee9494b58bea is going to be updated. [ 1058.925938] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.926108] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.926181] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.926457] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.926612] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.935562] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: IN_PROGRESS for 2s [ 1059.032789] env[70006]: INFO networking_nsxv3.common.synchronization [None req-0a679099-5a06-48f8-b023-37e0c6458432 tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1059.033972] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1059.034669] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.034669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.034669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.034669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.034853] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.035571] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.035571] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.035739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.035909] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.035979] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.116287] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.116433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.541978] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.045855] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.548179] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.548600] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.548600] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.548717] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.548717] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.548810] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be updated. [ 1060.586489] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.586636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.586713] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.586975] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.587144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.600211] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 1060.936613] env[70006]: INFO networking_nsxv3.common.synchronization [req-a7b7b4c3-7ee2-4300-a80d-15b91eb7673c req-17378999-4a80-4ae5-ae3d-b1d8829a4901 tempest-ServersTestJSON-1431904245 tempest-ServersTestJSON-1431904245-project-member] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1060.938706] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1060.940065] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.940332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.940400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.940644] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.940816] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.940967] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.941091] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.941342] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.941454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.941595] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.951638] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 152fa45c-61d1-4b26-872b-ee9494b58bea in Status: SUCCESS [ 1060.951934] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 152fa45c-61d1-4b26-872b-ee9494b58bea deletion is rescheduled due to dependency. [ 1060.952107] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.239294] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.239294] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.239294] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.239515] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.239737] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.239899] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.240054] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.240305] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.240452] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.240836] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1061.240965] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1061.241096] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1061.241221] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1061.241362] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1061.241473] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1061.241610] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1061.268242] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1061.268411] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1061.268552] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1061.268764] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.269117] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.270062] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.270062] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.270062] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.270062] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.444357] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.776027] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.776027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.776027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.776027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.776027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.776027] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84 not found, creating... [ 1061.776027] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.776027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.776027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.776027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.776027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.776773] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.776773] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.776880] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.777254] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.777882] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.778141] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84 is going to be created. [ 1061.800485] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.801500] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.801500] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.801500] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.801500] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.801740] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.947717] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.242353] env[70006]: INFO networking_nsxv3.common.synchronization [req-e9015792-e8c4-4ffc-a7c3-bdf79670ce37 req-a697ef0f-7cb5-41ee-9875-8988600a106d tempest-DeleteServersTestJSON-472565240 tempest-DeleteServersTestJSON-472565240-project-member] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1062.242865] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1062.243199] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.243466] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.243466] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.243613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.243775] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.243884] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.243944] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.244213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.244430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.244430] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.449136] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.449291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.449341] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.449607] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.449715] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.449847] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 1062.480982] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.481179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.481340] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.481637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.482545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.504118] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 1062.520278] env[70006]: INFO networking_nsxv3.common.synchronization [req-c956513b-b1c2-4c61-a243-58436c9beb49 req-2e2c3768-4625-4e17-9bef-ad85a71c2792 service nova] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_rules [ 1062.520622] env[70006]: INFO networking_nsxv3.common.synchronization [req-c956513b-b1c2-4c61-a243-58436c9beb49 req-2e2c3768-4625-4e17-9bef-ad85a71c2792 service nova] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1062.520922] env[70006]: INFO networking_nsxv3.common.synchronization [req-c956513b-b1c2-4c61-a243-58436c9beb49 req-2e2c3768-4625-4e17-9bef-ad85a71c2792 service nova] Enqueued Resource ID: 2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84 with Priority: HIGHEST for action port [ 1062.525095] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_rules [ 1062.525330] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1062.525511] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84 with Priority: HIGHEST for action port [ 1062.526584] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.526584] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.526584] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.528199] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.528199] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.528199] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.528199] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.528199] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.528199] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.609966] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 1062.610522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.610522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.610636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.610780] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.610894] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.610960] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.611131] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.611323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.611323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.612716] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.612716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.612716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.612716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.612716] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.612716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.612716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.612716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.612716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.612716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.612716] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.613968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.613968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.613968] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.613968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.613968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.613968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.613968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.613968] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.746761] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.747715] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.747715] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.747715] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.747874] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.748107] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.748212] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.748263] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.748868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.748868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.748868] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 1062.783164] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.783425] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.783425] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.783613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.783764] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.793553] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 1063.031186] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84 with status ACTIVE [ 1063.031186] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.031186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.031186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.031475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.031522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.031886] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.031886] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.031886] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.032056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.032104] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.032361] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.032477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.034032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.034032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.034032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.034032] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84 is going to be updated. [ 1063.056806] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.056962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.057022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.057229] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.057364] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.057523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c185ee8-90c3-4a81-b3d6-0b3f21e4fa84" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.116162] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcb3911f-9d2b-45be-a214-581dc745aaa9: rpc.has_security_group_logging(os_id): False [ 1063.117942] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.144149] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.144149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.144149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.144149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.144149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.144149] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.144433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.144433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.144502] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.144643] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.144767] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.144874] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.144937] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.145103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.145180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.145358] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.145452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.145515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.145657] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.145732] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.145819] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be updated. [ 1063.227455] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.227651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.227733] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.228062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.228221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.252486] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 1063.530579] env[70006]: INFO networking_nsxv3.common.synchronization [req-015eab31-1690-4179-ac7b-4bcc59abb595 req-7659df24-010f-484d-8bcb-5a9691e54105 tempest-ServerRescueTestJSON-144377210 tempest-ServerRescueTestJSON-144377210-project-member] Enqueued Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_members [ 1063.531127] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_members [ 1063.531485] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.531614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.531682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.531983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.532109] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.532208] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.532254] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.532404] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.532490] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.532585] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.620776] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.035187] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.035528] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.035528] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.035685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.035834] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.036144] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.036144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.036289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.036338] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.036415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.036498] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 already deleted. [ 1064.036577] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.092059] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-728 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.092334] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-728" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.092539] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-728" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.092862] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-728" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.093292] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.093432] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.093680] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.093785] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.093937] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.094168] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.094304] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.094391] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.094506] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.094613] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.094724] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.094860] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.117247] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.117502] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1064.117658] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.117846] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-728" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.118255] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-f27a5efc-f9a7-4cb7-8db5-e1e692932fe1 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.118357] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-f27a5efc-f9a7-4cb7-8db5-e1e692932fe1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.118474] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-f27a5efc-f9a7-4cb7-8db5-e1e692932fe1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.118817] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-f27a5efc-f9a7-4cb7-8db5-e1e692932fe1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.118962] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f27a5efc-f9a7-4cb7-8db5-e1e692932fe1',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.123799] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.123952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.124029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.124213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.124382] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.124526] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be updated. [ 1064.152569] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.152737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.152806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.153009] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.153162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.163279] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 1064.513104] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 1064.513463] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.621825] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.622077] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.622216] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.622555] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.622730] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.622865] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port f27a5efc-f9a7-4cb7-8db5-e1e692932fe1 not found, creating... [ 1064.623168] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.623455] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.623509] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.623748] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.623900] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.624238] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.624428] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.624553] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.624824] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.625035] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.625164] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: f27a5efc-f9a7-4cb7-8db5-e1e692932fe1 is going to be created. [ 1064.660878] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.661196] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.661406] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.661746] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.661997] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.662289] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-f27a5efc-f9a7-4cb7-8db5-e1e692932fe1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.804133] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 1064.804345] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 deletion is rescheduled due to dependency. [ 1064.804447] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.268013] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 1065.268295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.268420] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.271052] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.271052] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.485841] env[70006]: INFO networking_nsxv3.common.synchronization [req-015eab31-1690-4179-ac7b-4bcc59abb595 req-cda24e49-9ee2-4591-86a0-af96a9fd6a03 service nova] Enqueued Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_rules [ 1065.486139] env[70006]: INFO networking_nsxv3.common.synchronization [req-015eab31-1690-4179-ac7b-4bcc59abb595 req-cda24e49-9ee2-4591-86a0-af96a9fd6a03 service nova] Enqueued Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_members [ 1065.486356] env[70006]: INFO networking_nsxv3.common.synchronization [req-015eab31-1690-4179-ac7b-4bcc59abb595 req-cda24e49-9ee2-4591-86a0-af96a9fd6a03 service nova] Enqueued Resource ID: f27a5efc-f9a7-4cb7-8db5-e1e692932fe1 with Priority: HIGHEST for action port [ 1065.486614] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_rules [ 1065.486740] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_members [ 1065.486835] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f27a5efc-f9a7-4cb7-8db5-e1e692932fe1 with Priority: HIGHEST for action port [ 1065.487817] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a96b9fdf-0e4e-492b-ba29-5c5513d45f05 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.488327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.488443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.488775] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.488867] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.489850] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.489972] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.490050] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.490225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.490377] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.490470] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.490540] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.490684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.490773] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.490850] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.492403] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-f27a5efc-f9a7-4cb7-8db5-e1e692932fe1 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.492513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f27a5efc-f9a7-4cb7-8db5-e1e692932fe1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.492583] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f27a5efc-f9a7-4cb7-8db5-e1e692932fe1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.492740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f27a5efc-f9a7-4cb7-8db5-e1e692932fe1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.492818] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f27a5efc-f9a7-4cb7-8db5-e1e692932fe1',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.770960] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.771183] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.996258] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.996258] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.996258] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.996258] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f27a5efc-f9a7-4cb7-8db5-e1e692932fe1 with status ACTIVE [ 1065.997211] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.997211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.997211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.997211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.997211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.997518] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.997661] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.997767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.001892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.001892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.001892] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.001892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.001892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.001892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.001892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.001892] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f27a5efc-f9a7-4cb7-8db5-e1e692932fe1 is going to be updated. [ 1066.039067] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.039400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.039488] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.039724] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.039873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.040073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f27a5efc-f9a7-4cb7-8db5-e1e692932fe1" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.173871] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 1066.174324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.174595] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.174925] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.175206] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.175482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.175482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.175642] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.175727] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.175817] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.175953] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.192148] env[70006]: INFO networking_nsxv3.common.synchronization [req-f5ac78b0-1ac5-447b-b57c-39843d397fed req-9a2a5a24-13a2-4541-a439-3f1834e199a0 tempest-ServersTestFqdnHostnames-1659575620 tempest-ServersTestFqdnHostnames-1659575620-project-member] Enqueued Resource ID: beef0235-0372-4fe8-a0e3-e4255271d6ce with Priority: HIGHEST for action security_group_members [ 1066.192656] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beef0235-0372-4fe8-a0e3-e4255271d6ce with Priority: HIGHEST for action security_group_members [ 1066.192975] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-beef0235-0372-4fe8-a0e3-e4255271d6ce taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.193330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.193455] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.197059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.197059] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.197059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.197059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.197059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.197059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.197059] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('beef0235-0372-4fe8-a0e3-e4255271d6ce',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.500420] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.584344] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-538 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.584560] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-538" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.584694] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-538" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.585048] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-538" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.585310] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.585472] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.585603] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.585825] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.585976] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.586457] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.586628] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1066.586780] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1066.586932] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1066.587133] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1066.587304] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1066.587498] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1066.606101] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1066.606292] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1066.606434] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1066.606647] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-538" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.606988] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-4151335a-4b19-45bd-bf10-69e4960fe456 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.607220] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-4151335a-4b19-45bd-bf10-69e4960fe456" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.607303] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-4151335a-4b19-45bd-bf10-69e4960fe456" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.607631] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-4151335a-4b19-45bd-bf10-69e4960fe456" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.607775] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4151335a-4b19-45bd-bf10-69e4960fe456',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.682700] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.682865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.682936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.683179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.683349] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.683868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.683942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.684122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.684212] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.684304] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.684462] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.684552] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.684611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.684757] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.684891] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.684977] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.685049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.685189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.685262] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.685343] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.685451] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.699381] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.699536] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.699536] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.699677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.699766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.699948] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.700054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.700117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.700279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.700349] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.700416] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beef0235-0372-4fe8-a0e3-e4255271d6ce already deleted. [ 1066.700496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.002878] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.003064] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.003199] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.003356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.003449] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.003733] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 is going to be created. [ 1067.029589] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.029760] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.029813] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.029988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.030164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.039385] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 in Status: UNINITIALIZED for 2s [ 1067.110639] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.110865] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.110998] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.111368] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.111546] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.111706] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 4151335a-4b19-45bd-bf10-69e4960fe456 not found, creating... [ 1067.111973] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.112148] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.112273] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.112544] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.112691] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.112978] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.113181] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.113309] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.113523] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.113682] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.113831] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 4151335a-4b19-45bd-bf10-69e4960fe456 is going to be created. [ 1067.135713] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.135713] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.135713] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.136021] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.136540] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.136540] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-4151335a-4b19-45bd-bf10-69e4960fe456" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.187257] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcb3911f-9d2b-45be-a214-581dc745aaa9: rpc.has_security_group_logging(os_id): False [ 1067.224253] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.224253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.224253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.224253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.224253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.224253] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.224253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.224253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.224596] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.224596] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.224686] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.224740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.224776] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.224910] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.224982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.225183] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.225280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.225343] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.225482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.225556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.225641] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be updated. [ 1067.329712] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.329899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.330054] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.330329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.330564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.346659] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 1068.311509] env[70006]: INFO networking_nsxv3.common.synchronization [req-f5ac78b0-1ac5-447b-b57c-39843d397fed req-1c9339c1-699f-4eb5-a236-25ba24bbe88f service nova] Enqueued Resource ID: beef0235-0372-4fe8-a0e3-e4255271d6ce with Priority: HIGHEST for action security_group_rules [ 1068.311987] env[70006]: INFO networking_nsxv3.common.synchronization [req-f5ac78b0-1ac5-447b-b57c-39843d397fed req-1c9339c1-699f-4eb5-a236-25ba24bbe88f service nova] Enqueued Resource ID: beef0235-0372-4fe8-a0e3-e4255271d6ce with Priority: HIGHEST for action security_group_members [ 1068.311987] env[70006]: INFO networking_nsxv3.common.synchronization [req-f5ac78b0-1ac5-447b-b57c-39843d397fed req-1c9339c1-699f-4eb5-a236-25ba24bbe88f service nova] Enqueued Resource ID: 4151335a-4b19-45bd-bf10-69e4960fe456 with Priority: HIGHEST for action port [ 1068.312491] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beef0235-0372-4fe8-a0e3-e4255271d6ce with Priority: HIGHEST for action security_group_rules [ 1068.312642] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beef0235-0372-4fe8-a0e3-e4255271d6ce with Priority: HIGHEST for action security_group_members [ 1068.312728] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4151335a-4b19-45bd-bf10-69e4960fe456 with Priority: HIGHEST for action port [ 1068.313042] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-beef0235-0372-4fe8-a0e3-e4255271d6ce taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.313207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.313293] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.313520] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.313603] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('beef0235-0372-4fe8-a0e3-e4255271d6ce',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.315928] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-beef0235-0372-4fe8-a0e3-e4255271d6ce taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.316205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.316336] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.316584] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.316858] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.316858] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.316983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.317209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.317300] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.317421] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('beef0235-0372-4fe8-a0e3-e4255271d6ce',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.320393] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-4151335a-4b19-45bd-bf10-69e4960fe456 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.320393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4151335a-4b19-45bd-bf10-69e4960fe456" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.320393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4151335a-4b19-45bd-bf10-69e4960fe456" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.320393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4151335a-4b19-45bd-bf10-69e4960fe456" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.320393] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4151335a-4b19-45bd-bf10-69e4960fe456',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.819947] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('beef0235-0372-4fe8-a0e3-e4255271d6ce',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.820680] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-beef0235-0372-4fe8-a0e3-e4255271d6ce taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.820836] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.824241] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4151335a-4b19-45bd-bf10-69e4960fe456 with status ACTIVE [ 1068.824241] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.824241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.824241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.824241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.824522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.824522] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.824664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.824664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.825147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.825147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.825147] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.825147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.825332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.825332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.825404] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.825493] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4151335a-4b19-45bd-bf10-69e4960fe456 is going to be updated. [ 1068.849588] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.849811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.849917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.850245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.850576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.850832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4151335a-4b19-45bd-bf10-69e4960fe456" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.050337] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 in Status: SUCCESS [ 1069.050483] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.050649] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.050883] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.051088] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.051208] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.051273] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.051479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.051567] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.051667] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.052060] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.322871] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('beef0235-0372-4fe8-a0e3-e4255271d6ce',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.362164] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 1069.362390] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.553950] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.554133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.554213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.554479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.554645] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.554737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.554790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.554966] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.555396] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.555539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.555693] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.555789] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.555847] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.555995] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.556153] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.556238] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.556299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.556437] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.556514] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.556596] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.556687] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.828158] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.828158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.828158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.828158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.828158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.828158] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beef0235-0372-4fe8-a0e3-e4255271d6ce is going to be created. [ 1069.855098] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.857172] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.857444] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.857825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.861437] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.874256] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beef0235-0372-4fe8-a0e3-e4255271d6ce in Status: UNINITIALIZED for 2s [ 1070.058516] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a96b9fdf-0e4e-492b-ba29-5c5513d45f05: rpc.has_security_group_logging(os_id): False [ 1070.078132] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.078295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.078371] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.078613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.078698] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.078862] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.078960] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.079030] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.079189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.079295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.079510] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.079611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.079666] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.079814] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.079885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.080094] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.080222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.080339] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.080403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.080485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.080542] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 is going to be created. [ 1070.144672] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.144672] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.144672] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.144950] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.145085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.158370] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 in Status: IN_PROGRESS for 2s [ 1071.883972] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beef0235-0372-4fe8-a0e3-e4255271d6ce in Status: SUCCESS [ 1071.883972] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.884384] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.885028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.885028] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.885028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.885028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.885251] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.885251] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.885251] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.885354] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('beef0235-0372-4fe8-a0e3-e4255271d6ce',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.170964] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 in Status: SUCCESS [ 1072.171204] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.387905] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('beef0235-0372-4fe8-a0e3-e4255271d6ce',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.668505] env[70006]: INFO networking_nsxv3.common.synchronization [None req-429934d0-4d45-46f7-8017-605c23fd8fc6 None None] Enqueued Resource ID: da52333b-bc15-46ba-b0cc-15ce3d6e7d13 with Priority: HIGHEST for action port [ 1072.669070] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da52333b-bc15-46ba-b0cc-15ce3d6e7d13 with Priority: HIGHEST for action port [ 1072.670076] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-da52333b-bc15-46ba-b0cc-15ce3d6e7d13 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.670786] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da52333b-bc15-46ba-b0cc-15ce3d6e7d13" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.670786] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da52333b-bc15-46ba-b0cc-15ce3d6e7d13" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.671009] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da52333b-bc15-46ba-b0cc-15ce3d6e7d13" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.671212] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da52333b-bc15-46ba-b0cc-15ce3d6e7d13',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.762244] env[70006]: INFO networking_nsxv3.common.synchronization [req-1d081048-8c61-444c-9e8c-bb73d3559f50 req-ccc37aeb-2b3e-4f9e-97ac-9de4452ea118 tempest-ServerDiskConfigTestJSON-1226251677 tempest-ServerDiskConfigTestJSON-1226251677-project-member] Enqueued Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_members [ 1072.762964] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_members [ 1072.763321] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a51886-1748-4f34-be32-1ba9c09de405 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.763926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.763926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.763926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.763926] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.764217] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.764217] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.764217] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.764357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.764357] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.893646] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for beef0235-0372-4fe8-a0e3-e4255271d6ce: rpc.has_security_group_logging(os_id): False [ 1072.914448] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.914777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.914777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.915111] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.915294] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.915590] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.915700] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.915772] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.915953] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.916048] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.916137] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: beef0235-0372-4fe8-a0e3-e4255271d6ce is going to be created. [ 1072.977233] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.977380] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.977472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.977679] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.977862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.989225] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: beef0235-0372-4fe8-a0e3-e4255271d6ce in Status: IN_PROGRESS for 2s [ 1073.174187] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da52333b-bc15-46ba-b0cc-15ce3d6e7d13 [ 1073.174542] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.174671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.175069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.175069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.175069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.175276] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da52333b-bc15-46ba-b0cc-15ce3d6e7d13 already deleted. [ 1073.175276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da52333b-bc15-46ba-b0cc-15ce3d6e7d13" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.267839] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.269987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.269987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.269987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.288436] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.288646] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-303" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.288774] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-303" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.289064] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-303" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.289395] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.289523] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.289648] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.289884] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.290049] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.290271] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1073.290922] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.290922] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.290922] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.290922] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1073.290922] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.291130] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.293955] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.293955] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.293955] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.294186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.294186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.294252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.294360] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a51886-1748-4f34-be32-1ba9c09de405 is going to be updated. [ 1073.316199] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.316199] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1073.316328] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.316477] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-303" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.316826] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-c617a733-3882-4dd2-842d-f2be129d99ae taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.316998] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-c617a733-3882-4dd2-842d-f2be129d99ae" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.317139] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-c617a733-3882-4dd2-842d-f2be129d99ae" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.317506] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-c617a733-3882-4dd2-842d-f2be129d99ae" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.317653] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c617a733-3882-4dd2-842d-f2be129d99ae',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.330830] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.331056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.331056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.331265] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.331479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.342392] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a51886-1748-4f34-be32-1ba9c09de405 in Status: IN_PROGRESS for 2s [ 1073.821491] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.821491] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.821679] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.821841] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.822000] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.822185] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port c617a733-3882-4dd2-842d-f2be129d99ae not found, creating... [ 1073.822498] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.822755] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.822805] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.823938] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.824178] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.824522] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.824702] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.824857] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.825143] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.825296] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.825465] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: c617a733-3882-4dd2-842d-f2be129d99ae is going to be created. [ 1073.847439] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.847658] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.847790] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.848115] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.848822] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.848822] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-c617a733-3882-4dd2-842d-f2be129d99ae" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.667141] env[70006]: INFO networking_nsxv3.common.synchronization [req-1d081048-8c61-444c-9e8c-bb73d3559f50 req-b863612c-9776-464c-a34c-490aa6314df8 service nova] Enqueued Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_rules [ 1074.667398] env[70006]: INFO networking_nsxv3.common.synchronization [req-1d081048-8c61-444c-9e8c-bb73d3559f50 req-b863612c-9776-464c-a34c-490aa6314df8 service nova] Enqueued Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_members [ 1074.667581] env[70006]: INFO networking_nsxv3.common.synchronization [req-1d081048-8c61-444c-9e8c-bb73d3559f50 req-b863612c-9776-464c-a34c-490aa6314df8 service nova] Enqueued Resource ID: c617a733-3882-4dd2-842d-f2be129d99ae with Priority: HIGHEST for action port [ 1074.668033] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_rules [ 1074.668198] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_members [ 1074.668332] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c617a733-3882-4dd2-842d-f2be129d99ae with Priority: HIGHEST for action port [ 1074.668678] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1a51886-1748-4f34-be32-1ba9c09de405 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.668785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.668877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.669141] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.669250] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.670355] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a51886-1748-4f34-be32-1ba9c09de405 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.670488] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.670731] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-c617a733-3882-4dd2-842d-f2be129d99ae taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.670855] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c617a733-3882-4dd2-842d-f2be129d99ae" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.670936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c617a733-3882-4dd2-842d-f2be129d99ae" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.671158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c617a733-3882-4dd2-842d-f2be129d99ae" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.671245] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c617a733-3882-4dd2-842d-f2be129d99ae',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.919530] env[70006]: INFO networking_nsxv3.common.synchronization [None req-de96ae1d-88b4-435c-a0ed-dc6ba866512d None None] Enqueued Resource ID: d5e2b875-8add-487d-b1a6-ad75a672e5c3 with Priority: HIGHEST for action port [ 1074.919657] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5e2b875-8add-487d-b1a6-ad75a672e5c3 with Priority: HIGHEST for action port [ 1074.920457] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5e2b875-8add-487d-b1a6-ad75a672e5c3 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.920729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5e2b875-8add-487d-b1a6-ad75a672e5c3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.920908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5e2b875-8add-487d-b1a6-ad75a672e5c3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.921268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5e2b875-8add-487d-b1a6-ad75a672e5c3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.921540] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5e2b875-8add-487d-b1a6-ad75a672e5c3',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.002881] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: beef0235-0372-4fe8-a0e3-e4255271d6ce in Status: SUCCESS [ 1075.002881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.181087] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a51886-1748-4f34-be32-1ba9c09de405 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.182283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.187022] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c617a733-3882-4dd2-842d-f2be129d99ae with status ACTIVE [ 1075.187022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.187022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.187022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.187022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.187022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.187022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.187022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.187022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.187022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.187022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.187022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.187022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.187022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.187022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.187022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.187022] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c617a733-3882-4dd2-842d-f2be129d99ae is going to be updated. [ 1075.215653] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.215884] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.215986] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.216252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.216396] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.216564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c617a733-3882-4dd2-842d-f2be129d99ae" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.351899] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a51886-1748-4f34-be32-1ba9c09de405 in Status: SUCCESS [ 1075.352295] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a51886-1748-4f34-be32-1ba9c09de405 deletion is rescheduled due to dependency. [ 1075.352431] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.352595] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.352804] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.353185] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.353333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.353390] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.353581] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.353685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.353822] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.423665] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5e2b875-8add-487d-b1a6-ad75a672e5c3 [ 1075.423914] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.424057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.424142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.424335] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.424427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.424531] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5e2b875-8add-487d-b1a6-ad75a672e5c3 already deleted. [ 1075.424616] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5e2b875-8add-487d-b1a6-ad75a672e5c3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.856148] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.360067] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.864441] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.864764] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.864764] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.864916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.865024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.865151] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a51886-1748-4f34-be32-1ba9c09de405 is going to be updated. [ 1076.902168] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.902344] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.902398] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.902754] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.902868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.913670] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a51886-1748-4f34-be32-1ba9c09de405 in Status: IN_PROGRESS for 2s [ 1077.853430] env[70006]: INFO networking_nsxv3.common.synchronization [req-56ada936-9821-47a0-a0ac-cebc008c20c5 req-d04ee9c4-7465-4740-b652-29c33334b069 tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1077.853995] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1077.854305] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.854425] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.854490] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.854684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.854832] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.854920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.854979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.856594] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.856687] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.856803] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.361049] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.863035] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.930176] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a51886-1748-4f34-be32-1ba9c09de405 in Status: SUCCESS [ 1078.930423] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.930615] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.930859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.931088] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.931280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.931280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.931492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.931633] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.931708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.931821] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.107443] env[70006]: INFO networking_nsxv3.common.synchronization [None req-40143ca5-162e-4a79-95f0-114ee9e32ea3 tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1079.108627] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1079.109674] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.109917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.366182] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.366555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.366555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.366635] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.366709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.366809] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be updated. [ 1079.400090] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.400249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.400317] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.400541] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.400685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.412177] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 1079.433826] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a51886-1748-4f34-be32-1ba9c09de405 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.433998] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.434109] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.434347] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.434543] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.434696] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.434786] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.434971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.435099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.435214] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.435403] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a51886-1748-4f34-be32-1ba9c09de405 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.435501] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.435586] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.435755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.435923] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.436073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.436149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.436295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.436373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.436467] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.436561] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.938724] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1a51886-1748-4f34-be32-1ba9c09de405: rpc.has_security_group_logging(os_id): False [ 1079.956061] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.956263] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.956311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.956503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.956625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.956784] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.956879] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.956949] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.957121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.957211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.957396] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.957487] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.957560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.957684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.957759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.957936] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.958027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.958093] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.958738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.958738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.958738] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1a51886-1748-4f34-be32-1ba9c09de405 is going to be updated. [ 1080.019763] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.019937] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.020043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.020234] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.020357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.036372] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1a51886-1748-4f34-be32-1ba9c09de405 in Status: IN_PROGRESS for 2s [ 1081.427367] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 1081.427809] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.428255] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.428523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.428776] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.428963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.429088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.429301] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.429397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.429514] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.911166] env[70006]: INFO networking_nsxv3.common.synchronization [req-c37e5dff-9cba-41b4-a65e-26c2519d4b92 req-8b24db27-bcf7-419c-9610-47ba81ffa416 tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 with Priority: HIGHEST for action security_group_members [ 1081.911769] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 with Priority: HIGHEST for action security_group_members [ 1081.912139] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.912525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.912525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.912719] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.912774] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.912843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.913645] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.913645] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.913645] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.913645] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3c6c493-02b2-4cc9-86d0-15e7a48daae4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.933697] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.934186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.934410] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.934731] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.934956] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.935368] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.935638] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.936035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.936329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.936648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.938017] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be updated. [ 1081.975594] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.975594] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.975594] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.975594] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.975594] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.987157] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 1082.054652] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1a51886-1748-4f34-be32-1ba9c09de405 in Status: SUCCESS [ 1082.054943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.416075] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.416373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.416373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.416652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.437347] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.437920] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.437920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.437920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.438252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.438252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.438372] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 is going to be updated. [ 1082.473079] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.473079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.473369] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.473500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.473682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.486592] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 in Status: IN_PROGRESS for 2s [ 1083.999645] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 1084.000031] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 deletion is rescheduled due to dependency. [ 1084.000031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.500226] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 in Status: SUCCESS [ 1084.500226] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 deletion is rescheduled due to dependency. [ 1084.500356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.098124] env[70006]: INFO networking_nsxv3.common.synchronization [req-f20e2e22-8696-4a68-a1cc-61cc1def7c64 req-b235bc15-76cb-470f-a086-33ea25c64d82 tempest-ServerDiskConfigTestJSON-1226251677 tempest-ServerDiskConfigTestJSON-1226251677-project-member] Enqueued Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_members [ 1086.098824] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGHEST for action security_group_members [ 1086.099133] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1a51886-1748-4f34-be32-1ba9c09de405 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.099628] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.099726] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.100009] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.100303] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.100433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.100492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.100767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.100840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.100936] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.605797] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.606022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.606109] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.606287] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.606879] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.606879] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.606879] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.606879] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.606879] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.607263] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.607263] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a51886-1748-4f34-be32-1ba9c09de405 is going to be updated. [ 1086.643378] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.643708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.643708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.643813] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.644068] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.654201] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a51886-1748-4f34-be32-1ba9c09de405 in Status: IN_PROGRESS for 2s [ 1087.370817] env[70006]: INFO networking_nsxv3.common.synchronization [req-0d2518fe-ab46-4da0-9097-1d3045e02611 req-f70d125b-8b39-477e-abd8-72f9200db00e tempest-ServerPasswordTestJSON-1241276073 tempest-ServerPasswordTestJSON-1241276073-project-member] Enqueued Resource ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 with Priority: HIGHEST for action security_group_members [ 1087.371446] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 with Priority: HIGHEST for action security_group_members [ 1087.371843] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.372041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.372286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.372614] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.372824] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.372939] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.373020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.373242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.373388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.373503] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63af98c3-e3a7-4ddd-84ed-0fd58e3e4181',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.672484] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-924 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.672660] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-924" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.672811] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-924" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.673246] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-924" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.673633] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.673852] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.674036] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.674360] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.674570] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.674853] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1087.675075] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1087.675251] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1087.675411] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1087.675593] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1087.675776] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1087.675977] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1087.695036] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1087.695229] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1087.695377] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1087.695570] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-924" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.695896] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-a1c2291b-1a1f-484e-98f5-47d6947da8a8 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.696096] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-a1c2291b-1a1f-484e-98f5-47d6947da8a8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.696224] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-a1c2291b-1a1f-484e-98f5-47d6947da8a8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.696571] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-a1c2291b-1a1f-484e-98f5-47d6947da8a8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.696718] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1c2291b-1a1f-484e-98f5-47d6947da8a8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.879899] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.880147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.880147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.880373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.880470] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.880661] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.880762] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.880822] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.880965] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.881053] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.881141] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 already deleted. [ 1087.881217] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.199618] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.199899] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.200090] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.200480] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.200654] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.200848] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port a1c2291b-1a1f-484e-98f5-47d6947da8a8 not found, creating... [ 1088.201343] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.201572] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.201776] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.202105] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.202175] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.202474] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.202649] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.202793] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.203036] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.203197] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.203328] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: a1c2291b-1a1f-484e-98f5-47d6947da8a8 is going to be created. [ 1088.226878] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.227179] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.227398] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.228234] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.228546] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.228913] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-a1c2291b-1a1f-484e-98f5-47d6947da8a8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.668291] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1a51886-1748-4f34-be32-1ba9c09de405 in Status: SUCCESS [ 1088.668291] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1a51886-1748-4f34-be32-1ba9c09de405 deletion is rescheduled due to dependency. [ 1088.668291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.031336] env[70006]: INFO networking_nsxv3.common.synchronization [req-0d2518fe-ab46-4da0-9097-1d3045e02611 req-190cc46b-ae6d-49d2-8968-ce1aeb61d5fa service nova] Enqueued Resource ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 with Priority: HIGHEST for action security_group_rules [ 1089.031433] env[70006]: INFO networking_nsxv3.common.synchronization [req-0d2518fe-ab46-4da0-9097-1d3045e02611 req-190cc46b-ae6d-49d2-8968-ce1aeb61d5fa service nova] Enqueued Resource ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 with Priority: HIGHEST for action security_group_members [ 1089.031580] env[70006]: INFO networking_nsxv3.common.synchronization [req-0d2518fe-ab46-4da0-9097-1d3045e02611 req-190cc46b-ae6d-49d2-8968-ce1aeb61d5fa service nova] Enqueued Resource ID: a1c2291b-1a1f-484e-98f5-47d6947da8a8 with Priority: HIGHEST for action port [ 1089.032169] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 with Priority: HIGHEST for action security_group_rules [ 1089.032315] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 with Priority: HIGHEST for action security_group_members [ 1089.032429] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1c2291b-1a1f-484e-98f5-47d6947da8a8 with Priority: HIGHEST for action port [ 1089.032690] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.032837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.032903] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.033182] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.033266] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63af98c3-e3a7-4ddd-84ed-0fd58e3e4181',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.035879] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.036028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.036100] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.036286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.036443] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.036542] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.036606] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.036779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.036866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.036955] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63af98c3-e3a7-4ddd-84ed-0fd58e3e4181',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.037865] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1c2291b-1a1f-484e-98f5-47d6947da8a8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.037989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1c2291b-1a1f-484e-98f5-47d6947da8a8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.038070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1c2291b-1a1f-484e-98f5-47d6947da8a8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.038224] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1c2291b-1a1f-484e-98f5-47d6947da8a8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.038300] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1c2291b-1a1f-484e-98f5-47d6947da8a8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.539775] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63af98c3-e3a7-4ddd-84ed-0fd58e3e4181',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.540949] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.541182] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.541591] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1c2291b-1a1f-484e-98f5-47d6947da8a8 with status ACTIVE [ 1089.541885] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.542194] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.542194] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.542350] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.542443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.542625] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.542727] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.542794] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.542975] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.543118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.543360] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.543463] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.543549] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.543671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.543751] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.543836] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1c2291b-1a1f-484e-98f5-47d6947da8a8 is going to be updated. [ 1089.564850] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.565077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.565077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.565645] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.565645] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.565645] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1c2291b-1a1f-484e-98f5-47d6947da8a8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.042107] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63af98c3-e3a7-4ddd-84ed-0fd58e3e4181',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.544554] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.544680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.544827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.545263] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.545399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.545562] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 is going to be created. [ 1090.580466] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.580717] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.580788] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.581147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.581332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.598025] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 in Status: UNINITIALIZED for 2s [ 1091.109235] env[70006]: INFO networking_nsxv3.common.synchronization [req-e086aa1f-608f-4171-ad4e-f58a03e695ab req-e3461650-b6a7-4c47-9b55-0a03b395e9e7 tempest-ServersTestJSON-1431904245 tempest-ServersTestJSON-1431904245-project-member] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1091.109848] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1091.111685] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.111806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.111806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.112160] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.112302] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.112494] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.112494] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.112622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.112684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.113220] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.460013] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.460255] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.460422] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.460838] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.461164] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.461579] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.461771] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.462037] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.462197] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.462414] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.462660] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.462869] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.463028] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.463183] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.463311] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.463452] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.481938] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.482334] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1091.482498] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.482757] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.483147] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-f1b01fa4-dc57-40af-958b-ba24a089ab8d taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.483359] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-f1b01fa4-dc57-40af-958b-ba24a089ab8d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.483486] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-f1b01fa4-dc57-40af-958b-ba24a089ab8d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.483840] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-f1b01fa4-dc57-40af-958b-ba24a089ab8d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.484050] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1b01fa4-dc57-40af-958b-ba24a089ab8d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.615324] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.986679] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.986927] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.987247] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.987364] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.987519] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.987706] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port f1b01fa4-dc57-40af-958b-ba24a089ab8d not found, creating... [ 1091.988020] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.988208] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.988336] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.988561] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.988748] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.988986] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.989163] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.989318] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.989481] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.989617] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.989761] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: f1b01fa4-dc57-40af-958b-ba24a089ab8d is going to be created. [ 1092.013847] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.014369] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.014628] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.015092] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.015480] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.015892] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-f1b01fa4-dc57-40af-958b-ba24a089ab8d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.118408] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.608395] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 in Status: SUCCESS [ 1092.608570] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.608747] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.608979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.609191] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.609314] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.609375] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.609538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.609693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.609805] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.609902] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63af98c3-e3a7-4ddd-84ed-0fd58e3e4181',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.621236] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.621236] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.621371] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.621513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.621601] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.621761] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 1092.654256] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.654569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.654569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.655807] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.655807] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.665863] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 1092.918624] env[70006]: INFO networking_nsxv3.common.synchronization [req-e086aa1f-608f-4171-ad4e-f58a03e695ab req-32588c3d-9601-43b5-aa6f-0b4b10d54d45 service nova] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_rules [ 1092.918814] env[70006]: INFO networking_nsxv3.common.synchronization [req-e086aa1f-608f-4171-ad4e-f58a03e695ab req-32588c3d-9601-43b5-aa6f-0b4b10d54d45 service nova] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1092.919011] env[70006]: INFO networking_nsxv3.common.synchronization [req-e086aa1f-608f-4171-ad4e-f58a03e695ab req-32588c3d-9601-43b5-aa6f-0b4b10d54d45 service nova] Enqueued Resource ID: f1b01fa4-dc57-40af-958b-ba24a089ab8d with Priority: HIGHEST for action port [ 1092.919258] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_rules [ 1092.921177] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1092.921177] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1b01fa4-dc57-40af-958b-ba24a089ab8d with Priority: HIGHEST for action port [ 1092.921851] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.921984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.922112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.922301] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.922387] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.923521] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.923634] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.923914] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1b01fa4-dc57-40af-958b-ba24a089ab8d taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.926144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1b01fa4-dc57-40af-958b-ba24a089ab8d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.926267] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1b01fa4-dc57-40af-958b-ba24a089ab8d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.926481] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1b01fa4-dc57-40af-958b-ba24a089ab8d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.926666] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1b01fa4-dc57-40af-958b-ba24a089ab8d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.112419] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.112716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.112716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.112847] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.113010] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.113124] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.113190] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.113374] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.113466] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.113582] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.113779] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.113915] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.113915] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.114075] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.114223] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.114329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.114406] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.114505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.114583] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.114756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.114805] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63af98c3-e3a7-4ddd-84ed-0fd58e3e4181',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.429351] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.429876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.429876] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1b01fa4-dc57-40af-958b-ba24a089ab8d with status ACTIVE [ 1093.430015] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.433203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.433203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.433203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.433203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.433203] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.433203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.433203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.433203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.433203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.433203] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.433203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.433203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.433203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.433203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.433203] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1b01fa4-dc57-40af-958b-ba24a089ab8d is going to be updated. [ 1093.461020] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.461506] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.461506] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.461626] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.461764] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.462065] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1b01fa4-dc57-40af-958b-ba24a089ab8d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.617358] env[70006]: INFO networking_nsxv3.common.synchronization [req-39fc0e96-c803-4677-aed9-da9634742261 req-934d003d-2ed5-4e87-8600-b40005588785 tempest-ServersTestBootFromVolume-1562632258 tempest-ServersTestBootFromVolume-1562632258-project-member] Enqueued Resource ID: ec4d7bd2-dee8-4667-8923-366f583eec53 with Priority: HIGHEST for action security_group_members [ 1093.621732] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4d7bd2-dee8-4667-8923-366f583eec53 with Priority: HIGHEST for action security_group_members [ 1093.621732] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181: rpc.has_security_group_logging(os_id): False [ 1093.622720] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec4d7bd2-dee8-4667-8923-366f583eec53 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.622871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.622938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.623571] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.625675] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.625675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.625675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.625675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.625675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.625675] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec4d7bd2-dee8-4667-8923-366f583eec53',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.647954] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.648197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.648296] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.648584] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.648711] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.649056] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.649215] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.649321] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.649568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.649711] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.650020] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.650880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.650982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.651665] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.651665] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.651665] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.652156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.652256] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.652750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.652750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.652750] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 is going to be created. [ 1093.731793] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.731793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.731793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.731793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.731793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.750422] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 in Status: IN_PROGRESS for 2s [ 1093.995041] env[70006]: INFO networking_nsxv3.common.synchronization [req-576fef60-56d0-4b25-a0b4-0d386d0c9a84 req-a43bf903-5dc2-42e4-a747-a1e95af563bb tempest-AttachInterfacesUnderV243Test-1270413728 tempest-AttachInterfacesUnderV243Test-1270413728-project-member] Enqueued Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_members [ 1093.995041] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_members [ 1093.995989] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e260dc20-0003-47f6-b50c-1cb4b48cdd79 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.996289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.996485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.996968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.997270] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.997494] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.997661] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.997942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.998141] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.999440] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.024285] env[70006]: INFO networking_nsxv3.common.synchronization [req-576fef60-56d0-4b25-a0b4-0d386d0c9a84 req-a43bf903-5dc2-42e4-a747-a1e95af563bb tempest-AttachInterfacesUnderV243Test-1270413728 tempest-AttachInterfacesUnderV243Test-1270413728-project-member] Enqueued Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_rules [ 1094.024285] env[70006]: INFO networking_nsxv3.common.synchronization [req-576fef60-56d0-4b25-a0b4-0d386d0c9a84 req-a43bf903-5dc2-42e4-a747-a1e95af563bb tempest-AttachInterfacesUnderV243Test-1270413728 tempest-AttachInterfacesUnderV243Test-1270413728-project-member] Enqueued Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_members [ 1094.024285] env[70006]: INFO networking_nsxv3.common.synchronization [req-576fef60-56d0-4b25-a0b4-0d386d0c9a84 req-a43bf903-5dc2-42e4-a747-a1e95af563bb tempest-AttachInterfacesUnderV243Test-1270413728 tempest-AttachInterfacesUnderV243Test-1270413728-project-member] Enqueued Resource ID: 38ceae0a-4242-4587-9200-5cb36bbb5814 with Priority: HIGHEST for action port [ 1094.026176] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_rules [ 1094.026577] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_members [ 1094.026987] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ceae0a-4242-4587-9200-5cb36bbb5814 with Priority: HIGHEST for action port [ 1094.027689] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.028933] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.028933] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.028933] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.028933] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.030664] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e260dc20-0003-47f6-b50c-1cb4b48cdd79 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.030664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.030664] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-38ceae0a-4242-4587-9200-5cb36bbb5814 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.030664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.030664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.030664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.030664] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38ceae0a-4242-4587-9200-5cb36bbb5814',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.130022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.130022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.130022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.130022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.130022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.130022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.130022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.130022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.130022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.130022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.130022] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec4d7bd2-dee8-4667-8923-366f583eec53 is going to be updated. [ 1094.166246] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.166395] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.166468] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.166688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.166840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.172511] env[70006]: INFO networking_nsxv3.common.synchronization [None req-d52f8899-6679-4b15-8654-915bdb68093d tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_rules [ 1094.173052] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_rules [ 1094.173354] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.173479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.173547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.173844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.173951] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.175605] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec4d7bd2-dee8-4667-8923-366f583eec53 in Status: IN_PROGRESS for 2s [ 1094.310581] env[70006]: INFO networking_nsxv3.common.synchronization [None req-1e67ac50-7274-4d67-bf71-ed33a57d158f tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_rules [ 1094.311157] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_rules [ 1094.311464] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.311569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.501569] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.533141] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e260dc20-0003-47f6-b50c-1cb4b48cdd79 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.533141] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.537397] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38ceae0a-4242-4587-9200-5cb36bbb5814 with status ACTIVE [ 1094.537397] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.537397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.537397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.537397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.537397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.537397] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.537397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.537397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.537397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.537397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.537397] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.537397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.537397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.537397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.538606] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.538606] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38ceae0a-4242-4587-9200-5cb36bbb5814 is going to be updated. [ 1094.569779] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.569779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.569779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.569779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.569779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.569779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.683506] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 1094.683881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.684040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.684333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.684542] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.684682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.684755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.685129] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.685129] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.685129] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.711536] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.711770] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.711996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.712286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.712383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.712486] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a already deleted. [ 1094.712568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.712728] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.712890] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.712975] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.003959] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.187088] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.234884] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.234884] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.234884] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.234884] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.235183] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.235183] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a already deleted. [ 1095.235183] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.506986] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.506986] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.507342] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.507342] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.507515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.508221] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 is going to be updated. [ 1095.540333] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.540521] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.540606] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.540841] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.541067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.553752] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 in Status: IN_PROGRESS for 2s [ 1095.616964] env[70006]: INFO networking_nsxv3.common.synchronization [req-9c066b41-ce50-4aad-91fc-2bbd5e936fc3 req-5b9e1eeb-36d4-4f38-82a1-79d13abf6e79 tempest-DeleteServersTestJSON-472565240 tempest-DeleteServersTestJSON-472565240-project-member] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1095.617696] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1095.618130] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.618420] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.618522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.618734] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.618963] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.619222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.619323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.619440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.619554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.619663] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.689110] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.767384] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 in Status: SUCCESS [ 1095.767736] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.985254] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.985475] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.985584] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.985857] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.986129] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.986296] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.986419] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.986638] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.986788] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.987008] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1095.987130] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.987243] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.987356] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.987470] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1095.987578] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.987762] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.007031] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.007214] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1096.007357] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.007535] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.007865] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-ba7e21fc-95aa-4d9c-b548-695aa34fbbb7 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.009014] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-ba7e21fc-95aa-4d9c-b548-695aa34fbbb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.009014] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-ba7e21fc-95aa-4d9c-b548-695aa34fbbb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.009014] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-ba7e21fc-95aa-4d9c-b548-695aa34fbbb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.009014] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba7e21fc-95aa-4d9c-b548-695aa34fbbb7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.122617] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.122878] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.123086] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.123159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.123264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.123461] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.123556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.123629] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.123760] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.123838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.123923] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 1096.152282] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.152282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.152282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.152282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.152282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.159869] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 1096.187062] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec4d7bd2-dee8-4667-8923-366f583eec53 in Status: SUCCESS [ 1096.187251] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec4d7bd2-dee8-4667-8923-366f583eec53 deletion is rescheduled due to dependency. [ 1096.187374] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.193314] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.193485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.193565] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.193752] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.193863] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.193927] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 1096.234152] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.234329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.234418] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.234660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.234818] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.244660] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 1096.513036] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.513531] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.513575] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.514117] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.514422] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.514816] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port ba7e21fc-95aa-4d9c-b548-695aa34fbbb7 not found, creating... [ 1096.515361] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.515582] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.515754] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.516057] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.516255] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.516599] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.516808] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.516973] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.517250] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.517430] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.517610] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: ba7e21fc-95aa-4d9c-b548-695aa34fbbb7 is going to be created. [ 1096.540538] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.540816] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.540993] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.541354] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.541658] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.542046] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-ba7e21fc-95aa-4d9c-b548-695aa34fbbb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.723438] env[70006]: INFO networking_nsxv3.common.synchronization [req-f144fffb-c7b2-4c4d-8240-a1ad8a365443 req-7c5774f8-0d48-4e16-acc2-e136169a1983 tempest-AttachInterfacesUnderV243Test-1270413728 tempest-AttachInterfacesUnderV243Test-1270413728-project-member] Enqueued Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_members [ 1096.724131] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_members [ 1096.725233] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e260dc20-0003-47f6-b50c-1cb4b48cdd79 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.725233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.744280] env[70006]: INFO networking_nsxv3.common.synchronization [req-f144fffb-c7b2-4c4d-8240-a1ad8a365443 req-7c5774f8-0d48-4e16-acc2-e136169a1983 tempest-AttachInterfacesUnderV243Test-1270413728 tempest-AttachInterfacesUnderV243Test-1270413728-project-member] Enqueued Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_rules [ 1096.744477] env[70006]: INFO networking_nsxv3.common.synchronization [req-f144fffb-c7b2-4c4d-8240-a1ad8a365443 req-7c5774f8-0d48-4e16-acc2-e136169a1983 tempest-AttachInterfacesUnderV243Test-1270413728 tempest-AttachInterfacesUnderV243Test-1270413728-project-member] Enqueued Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_members [ 1096.744621] env[70006]: INFO networking_nsxv3.common.synchronization [req-f144fffb-c7b2-4c4d-8240-a1ad8a365443 req-7c5774f8-0d48-4e16-acc2-e136169a1983 tempest-AttachInterfacesUnderV243Test-1270413728 tempest-AttachInterfacesUnderV243Test-1270413728-project-member] Enqueued Resource ID: 38ceae0a-4242-4587-9200-5cb36bbb5814 with Priority: HIGHEST for action port [ 1096.745134] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_rules [ 1096.745322] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_members [ 1096.745419] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ceae0a-4242-4587-9200-5cb36bbb5814 with Priority: HIGHEST for action port [ 1096.745630] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.745731] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.745927] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e260dc20-0003-47f6-b50c-1cb4b48cdd79 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.746157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.746625] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-38ceae0a-4242-4587-9200-5cb36bbb5814 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.746738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.746801] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.747010] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.747100] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38ceae0a-4242-4587-9200-5cb36bbb5814',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.252563] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38ceae0a-4242-4587-9200-5cb36bbb5814 with status ACTIVE [ 1097.252563] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.252563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.252563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.252563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.252563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.252563] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.252563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.252563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.252563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.252563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.252563] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.252563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.252563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.253109] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.253109] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.253109] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38ceae0a-4242-4587-9200-5cb36bbb5814 is going to be updated. [ 1097.255417] env[70006]: INFO networking_nsxv3.common.synchronization [req-9c066b41-ce50-4aad-91fc-2bbd5e936fc3 req-1a8704f0-f106-4f78-bafa-d7839b36d8d0 service nova] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_rules [ 1097.255417] env[70006]: INFO networking_nsxv3.common.synchronization [req-9c066b41-ce50-4aad-91fc-2bbd5e936fc3 req-1a8704f0-f106-4f78-bafa-d7839b36d8d0 service nova] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1097.255417] env[70006]: INFO networking_nsxv3.common.synchronization [req-9c066b41-ce50-4aad-91fc-2bbd5e936fc3 req-1a8704f0-f106-4f78-bafa-d7839b36d8d0 service nova] Enqueued Resource ID: ba7e21fc-95aa-4d9c-b548-695aa34fbbb7 with Priority: HIGHEST for action port [ 1097.255875] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_rules [ 1097.255875] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1097.255875] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba7e21fc-95aa-4d9c-b548-695aa34fbbb7 with Priority: HIGHEST for action port [ 1097.256553] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.256553] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.256553] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.256713] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.256772] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.260140] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.260140] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.260140] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba7e21fc-95aa-4d9c-b548-695aa34fbbb7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.260140] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba7e21fc-95aa-4d9c-b548-695aa34fbbb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.260140] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba7e21fc-95aa-4d9c-b548-695aa34fbbb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.260140] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba7e21fc-95aa-4d9c-b548-695aa34fbbb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.260140] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba7e21fc-95aa-4d9c-b548-695aa34fbbb7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.280872] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.281064] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.281144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.281368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.281543] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.281687] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38ceae0a-4242-4587-9200-5cb36bbb5814" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.566103] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 in Status: SUCCESS [ 1097.566496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.566592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.566827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.567078] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.567318] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.567318] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.567498] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.567605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.567726] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.765785] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.765785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.765785] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba7e21fc-95aa-4d9c-b548-695aa34fbbb7 with status ACTIVE [ 1097.765785] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.765785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.765785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.765785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.765785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.765785] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.765785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.765785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.765785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.765785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.766357] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.766357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.766357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.766357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.766357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.766533] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba7e21fc-95aa-4d9c-b548-695aa34fbbb7 is going to be updated. [ 1097.790978] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.791659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.791659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.791659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.791911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.792307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba7e21fc-95aa-4d9c-b548-695aa34fbbb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.071020] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.093213] env[70006]: INFO networking_nsxv3.common.synchronization [req-8084d991-a07b-4ba7-8e38-17eb3349b250 req-2d138a39-5eca-4453-b083-b5852596c626 tempest-ServerRescueTestJSON-144377210 tempest-ServerRescueTestJSON-144377210-project-member] Enqueued Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_members [ 1098.093345] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_members [ 1098.093681] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.093821] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.093892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.095282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.096133] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.096492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.096642] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.096908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.097067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.097234] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.172271] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 1098.172462] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 deletion is rescheduled due to dependency. [ 1098.172579] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.172766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.173081] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.173269] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.173392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.173459] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.173617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.173700] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.173796] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.256032] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 1098.256032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.256032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.256032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.256032] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.256032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.256032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.256032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.256032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.256032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.256032] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.424374] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-728 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.424582] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-728" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.424713] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-728" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.424991] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-728" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.425258] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.425418] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.425589] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.425998] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.426172] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.426383] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1098.426502] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1098.426614] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1098.426726] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1098.426839] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1098.426950] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1098.427098] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1098.451337] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1098.451514] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1098.451658] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1098.452033] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-728" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.452302] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-1d2febcb-8ea3-4126-8de7-7bbe2f7162ec taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.452482] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-1d2febcb-8ea3-4126-8de7-7bbe2f7162ec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.452607] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-1d2febcb-8ea3-4126-8de7-7bbe2f7162ec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.453033] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-1d2febcb-8ea3-4126-8de7-7bbe2f7162ec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.453186] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d2febcb-8ea3-4126-8de7-7bbe2f7162ec',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.573517] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.603379] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.675780] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.758573] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.758573] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.758899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.758899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.759052] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.759157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.759235] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.759390] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.759475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.759578] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.759776] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.759885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.759951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.760078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.760232] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.760324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.760383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.760534] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.760610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.760695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.760881] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.955848] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.956110] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.956249] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.956546] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.956705] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.956870] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 1d2febcb-8ea3-4126-8de7-7bbe2f7162ec not found, creating... [ 1098.957154] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.957319] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.957444] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.957677] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.957821] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.958117] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.958279] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.958414] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.958627] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.958765] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.958909] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 1d2febcb-8ea3-4126-8de7-7bbe2f7162ec is going to be created. [ 1098.980297] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.980625] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.980789] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.981182] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.981450] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.981682] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-1d2febcb-8ea3-4126-8de7-7bbe2f7162ec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.076588] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.076792] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.076845] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.077048] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.077148] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.077251] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 is going to be updated. [ 1099.107418] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.123862] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.124169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.124169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.124366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.124514] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.137312] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 in Status: IN_PROGRESS for 2s [ 1099.179114] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.264038] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b2723f9-b1dc-419e-b339-13aae985829f: rpc.has_security_group_logging(os_id): False [ 1099.290329] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.290628] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.290751] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.291053] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.291171] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.291481] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.291688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.291688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.292471] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.292471] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.292471] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.292471] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.293835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.293835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.293835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.293835] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.293835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.294477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.294477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.294477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.294477] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 1099.377448] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.377448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.377672] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.378320] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.378320] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.394141] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 1099.609739] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.610093] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.610093] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.610210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.610300] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.610397] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 is going to be updated. [ 1099.640037] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.640227] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.640306] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.640516] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.640660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.650502] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 in Status: IN_PROGRESS for 2s [ 1099.680643] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.680752] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.680829] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.681052] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.681147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.681247] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 1099.709278] env[70006]: INFO networking_nsxv3.common.synchronization [req-8084d991-a07b-4ba7-8e38-17eb3349b250 req-930e4469-b4cf-4de6-bce8-99dc0831585b service nova] Enqueued Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_rules [ 1099.709478] env[70006]: INFO networking_nsxv3.common.synchronization [req-8084d991-a07b-4ba7-8e38-17eb3349b250 req-930e4469-b4cf-4de6-bce8-99dc0831585b service nova] Enqueued Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_members [ 1099.709628] env[70006]: INFO networking_nsxv3.common.synchronization [req-8084d991-a07b-4ba7-8e38-17eb3349b250 req-930e4469-b4cf-4de6-bce8-99dc0831585b service nova] Enqueued Resource ID: 1d2febcb-8ea3-4126-8de7-7bbe2f7162ec with Priority: HIGHEST for action port [ 1099.710182] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_rules [ 1099.710324] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_members [ 1099.711135] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d2febcb-8ea3-4126-8de7-7bbe2f7162ec with Priority: HIGHEST for action port [ 1099.711213] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a96b9fdf-0e4e-492b-ba29-5c5513d45f05 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.711361] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.711494] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.712066] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.712066] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.712727] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.712932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.713233] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d2febcb-8ea3-4126-8de7-7bbe2f7162ec taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.713345] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d2febcb-8ea3-4126-8de7-7bbe2f7162ec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.713415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d2febcb-8ea3-4126-8de7-7bbe2f7162ec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.713862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d2febcb-8ea3-4126-8de7-7bbe2f7162ec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.713862] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d2febcb-8ea3-4126-8de7-7bbe2f7162ec',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.719025] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.719025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.719025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.719025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.719025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.725945] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 1100.216436] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.216642] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.219330] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d2febcb-8ea3-4126-8de7-7bbe2f7162ec with status ACTIVE [ 1100.219558] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.219675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.219740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.220055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.220232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.220530] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.220699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.220808] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.221101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.221239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.221551] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.221707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.222051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.222051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.222051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.222227] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d2febcb-8ea3-4126-8de7-7bbe2f7162ec is going to be updated. [ 1100.268724] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.268867] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.268867] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.269069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.269218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.269498] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d2febcb-8ea3-4126-8de7-7bbe2f7162ec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.921739] env[70006]: INFO networking_nsxv3.common.synchronization [req-2a03c0d5-a0ea-4709-a1de-122db3fae28b req-e56a360e-eee7-4134-a79a-3ba85cbbc416 tempest-ServerPasswordTestJSON-1241276073 tempest-ServerPasswordTestJSON-1241276073-project-member] Enqueued Resource ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 with Priority: HIGHEST for action security_group_members [ 1100.923480] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 with Priority: HIGHEST for action security_group_members [ 1100.923891] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.924551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.924818] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.924887] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.926023] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.926167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.926167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.926339] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.926433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.926531] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63af98c3-e3a7-4ddd-84ed-0fd58e3e4181',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.032929] env[70006]: INFO networking_nsxv3.common.synchronization [req-f525d498-b991-45f2-b892-924426ec8c4a req-1d4344da-b239-436d-a155-591cd1c5d63b tempest-AttachInterfacesUnderV243Test-1270413728 tempest-AttachInterfacesUnderV243Test-1270413728-project-member] Enqueued Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_members [ 1101.033450] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 with Priority: HIGHEST for action security_group_members [ 1101.034717] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e260dc20-0003-47f6-b50c-1cb4b48cdd79 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.034891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.151142] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 in Status: SUCCESS [ 1101.151250] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.151547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.151806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.152029] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.152160] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.152226] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.152397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.152482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.152571] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.152676] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.158057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.158057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.158057] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.158057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.158057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.158057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.158057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.158057] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.424586] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 1101.425129] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.428719] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.429122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.429239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.429630] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.429630] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.429810] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.429913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.429973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.430160] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.430238] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.430335] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 is going to be updated. [ 1101.468522] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.468682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.468755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.469148] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.469275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.480432] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 in Status: IN_PROGRESS for 2s [ 1101.656325] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.661581] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 in Status: SUCCESS [ 1101.661813] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.662184] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.662310] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.662377] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.662588] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.662657] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.662848] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.662967] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.663041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.663211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.663289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.663377] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 is going to be updated. [ 1101.665172] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.665266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.665424] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.665525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.665633] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.666963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.667071] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.667166] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.703281] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.703576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.703576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.703760] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.703911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.716213] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 in Status: IN_PROGRESS for 2s [ 1101.739015] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 1101.739393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.740569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.740817] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.741415] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.741415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.741415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.741845] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.741985] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.742097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.742203] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.162226] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e260dc20-0003-47f6-b50c-1cb4b48cdd79: rpc.has_security_group_logging(os_id): False [ 1102.171118] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.186679] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.186868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.187011] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.187450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.187450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.187640] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.187699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.187882] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.187974] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.189030] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.189030] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 is going to be updated. [ 1102.245583] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.245828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.245828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.246100] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.247307] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.247307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.247307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.247307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.247307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.247307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.247307] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.247307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.247307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.247667] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.247667] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.247667] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.247667] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.247804] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.247851] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.247919] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.248037] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.285417] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.285417] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.285417] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.285417] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.285417] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.299887] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 in Status: IN_PROGRESS for 2s [ 1102.674530] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.751573] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5: rpc.has_security_group_logging(os_id): False [ 1102.772252] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.772459] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.772515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.772762] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.772878] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.773204] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.773347] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.773445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.773743] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.773743] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.773944] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.774068] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.774157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.774334] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.774425] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.774633] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.774729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.774793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.774987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.775083] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.775184] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 1102.839418] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.839621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.839783] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.840050] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.840261] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.854703] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 1102.931887] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.932818] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.933208] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.933635] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.934086] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.934334] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.934485] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.934804] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.935016] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.935312] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1102.935497] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.935642] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.935814] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.935993] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1102.936210] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.936433] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.956647] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.956820] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1102.956964] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.957169] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.957746] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-3fc25179-89cf-42de-b6b6-f31806bcbce3 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.957746] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.957964] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.958081] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.958224] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fc25179-89cf-42de-b6b6-f31806bcbce3',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.176955] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.177233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.177233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.178301] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.178301] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.178301] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 is going to be updated. [ 1103.211957] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.212175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.212279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.212524] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.212678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.223953] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 in Status: IN_PROGRESS for 2s [ 1103.461993] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.462310] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.463524] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.463524] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.463524] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.463524] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.463524] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.463933] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.463933] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.463933] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.464281] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.464480] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.464577] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.464917] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.464988] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.465199] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 3fc25179-89cf-42de-b6b6-f31806bcbce3 is going to be updated. [ 1103.490777] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.491043] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.491273] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.492071] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.492071] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.492254] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.493987] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 in Status: SUCCESS [ 1103.494340] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 deletion is rescheduled due to dependency. [ 1103.494458] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.732172] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 in Status: SUCCESS [ 1103.732441] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 deletion is rescheduled due to dependency. [ 1103.732629] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.733166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.733352] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.733581] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.733799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.733865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.734983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.735221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.735392] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.211753] env[70006]: INFO networking_nsxv3.common.synchronization [req-6f57392a-4d1e-4e84-9d36-a9bdc4f56f8a req-909e2398-f29b-4be0-8955-c566c888a24a service nova] Enqueued Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_rules [ 1104.214370] env[70006]: INFO networking_nsxv3.common.synchronization [req-6f57392a-4d1e-4e84-9d36-a9bdc4f56f8a req-909e2398-f29b-4be0-8955-c566c888a24a service nova] Enqueued Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_members [ 1104.214552] env[70006]: INFO networking_nsxv3.common.synchronization [req-6f57392a-4d1e-4e84-9d36-a9bdc4f56f8a req-909e2398-f29b-4be0-8955-c566c888a24a service nova] Enqueued Resource ID: 3fc25179-89cf-42de-b6b6-f31806bcbce3 with Priority: HIGHEST for action port [ 1104.219394] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_rules [ 1104.219619] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_members [ 1104.219679] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fc25179-89cf-42de-b6b6-f31806bcbce3 with Priority: HIGHEST for action port [ 1104.220501] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.220672] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.220733] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.220922] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.221016] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.222274] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.222443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.222500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.222681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.222841] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.223048] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.223048] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.226088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.226191] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.226283] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.227541] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fc25179-89cf-42de-b6b6-f31806bcbce3 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.227708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.227708] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.227873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.227950] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fc25179-89cf-42de-b6b6-f31806bcbce3',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.241492] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.241653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.241653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.241837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.241971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.242200] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.242300] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.242358] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.243402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.243402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.243402] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 is going to be updated. [ 1104.268555] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.268821] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.268821] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.269276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.269276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.280611] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 in Status: IN_PROGRESS for 2s [ 1104.320633] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 in Status: SUCCESS [ 1104.320799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.320901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.321117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.321255] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.729396] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.730637] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.730783] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.732742] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fc25179-89cf-42de-b6b6-f31806bcbce3 with status ACTIVE [ 1104.733213] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.733213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.733213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.733493] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.733588] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.733774] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.733876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.733939] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.734129] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.734195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.734385] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.734472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.734524] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.734660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.734750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.734819] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fc25179-89cf-42de-b6b6-f31806bcbce3 is going to be updated. [ 1104.893290] env[70006]: INFO networking_nsxv3.common.synchronization [None req-48d98f71-423e-4df8-8585-0bf3a9fde35e None None] Enqueued Resource ID: f3a560b4-8195-4736-a119-524516714062 with Priority: HIGHEST for action port [ 1104.894919] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.895139] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.895272] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.895590] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.895820] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.896099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fc25179-89cf-42de-b6b6-f31806bcbce3" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.899872] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3a560b4-8195-4736-a119-524516714062 with Priority: HIGHEST for action port [ 1104.900924] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3a560b4-8195-4736-a119-524516714062 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.901134] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3a560b4-8195-4736-a119-524516714062" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.901260] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3a560b4-8195-4736-a119-524516714062" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.903942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3a560b4-8195-4736-a119-524516714062" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.903942] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3a560b4-8195-4736-a119-524516714062',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.915506] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 1104.915623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.920544] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.921598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.921598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.921598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.921598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.921598] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 is going to be deleted. [ 1104.985304] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.985505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.985505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.985728] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.985822] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.986015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.201624] env[70006]: INFO networking_nsxv3.common.synchronization [req-aef764b8-21bc-4144-8c4b-42c254c0fc3e req-5436556b-3365-4a92-962b-5fcd12597685 tempest-ServersTestJSON-1431904245 tempest-ServersTestJSON-1431904245-project-member] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1105.202488] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1105.204095] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.204095] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.204095] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.204095] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.204095] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.204095] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.204095] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.204095] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.204095] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.204095] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.232845] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.237260] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 in Status: SUCCESS [ 1105.237486] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.238262] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.238861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.239077] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.239211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.239275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.239437] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.239523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.239610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.239699] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.405217] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3a560b4-8195-4736-a119-524516714062 [ 1105.405854] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.405854] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.405854] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.405854] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.406117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.406117] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3a560b4-8195-4736-a119-524516714062 already deleted. [ 1105.406188] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3a560b4-8195-4736-a119-524516714062" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.706562] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.739538] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.739538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.739538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.739538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.739538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.739538] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c is going to be updated. [ 1105.743799] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.743799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.743799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.743799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.743799] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.743799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.743799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.743799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.743799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.743799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.743799] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.743799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.743799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.743799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.743799] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.743799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.744828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.744828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.744828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.744828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.744828] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.769213] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.769213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.771072] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.771072] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.771072] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.780137] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c in Status: IN_PROGRESS for 2s [ 1106.211330] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.247154] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a96b9fdf-0e4e-492b-ba29-5c5513d45f05: rpc.has_security_group_logging(os_id): False [ 1106.268220] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.268415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.268472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.268652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.268765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.268936] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.269049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.269125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.269323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.269407] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.269603] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.269697] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.269757] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.269937] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.270139] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.270453] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.270563] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.270628] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.270768] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.270839] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.270929] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 is going to be updated. [ 1106.296972] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 in Status: SUCCESS [ 1106.297337] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 deletion is rescheduled due to dependency. [ 1106.297657] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.297876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.298171] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.298401] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.298529] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.298606] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.298778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.298854] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.299084] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e260dc20-0003-47f6-b50c-1cb4b48cdd79',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.367362] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.367595] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.367595] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.367787] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.367937] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.381444] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 in Status: IN_PROGRESS for 2s [ 1106.714162] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.714162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.714162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.714162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.714162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.714162] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 1106.743694] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.743927] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.743927] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.744277] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.744470] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.754643] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 1106.801287] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.801786] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.801935] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.802441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.802441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.802578] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.802578] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.802677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.806023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.806023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.806023] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e260dc20-0003-47f6-b50c-1cb4b48cdd79 is going to be deleted. [ 1106.850169] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.850169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.850169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.850169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.850169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.850169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e260dc20-0003-47f6-b50c-1cb4b48cdd79" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.065282] env[70006]: INFO networking_nsxv3.common.synchronization [None req-9e6bdbb0-6911-4584-a3a5-1ac1286adb7b None None] Enqueued Resource ID: 42d792da-3b7e-41b0-88aa-cc6b2130fbf4 with Priority: HIGHEST for action port [ 1107.065541] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d792da-3b7e-41b0-88aa-cc6b2130fbf4 with Priority: HIGHEST for action port [ 1107.066117] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-42d792da-3b7e-41b0-88aa-cc6b2130fbf4 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.066243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42d792da-3b7e-41b0-88aa-cc6b2130fbf4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.066312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42d792da-3b7e-41b0-88aa-cc6b2130fbf4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.066564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42d792da-3b7e-41b0-88aa-cc6b2130fbf4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.066648] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42d792da-3b7e-41b0-88aa-cc6b2130fbf4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.569759] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42d792da-3b7e-41b0-88aa-cc6b2130fbf4 [ 1107.570068] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.570564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.570641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.570851] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.570942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.571064] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42d792da-3b7e-41b0-88aa-cc6b2130fbf4 already deleted. [ 1107.571151] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42d792da-3b7e-41b0-88aa-cc6b2130fbf4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.791593] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c in Status: SUCCESS [ 1107.791838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.792038] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.792331] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.792529] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.792643] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.792707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.792858] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.792937] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.793032] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.793121] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.296484] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.394283] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 in Status: SUCCESS [ 1108.394550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.765857] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 1108.765857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.798806] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f682c5f3-6947-4cf3-a94e-7b777b1efe4c: rpc.has_security_group_logging(os_id): False [ 1108.820361] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.820603] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.820702] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.820937] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.846117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.846117] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.846117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.846117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.846117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.846117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.846117] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c is going to be updated. [ 1108.907324] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.907625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.907625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.907787] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.907981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.921166] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c in Status: IN_PROGRESS for 2s [ 1109.620560] env[70006]: INFO networking_nsxv3.common.synchronization [req-5b9e3252-3f2c-4684-93d3-f66289b12756 req-7db138ec-4156-49eb-bcdd-7225e23501b2 tempest-DeleteServersTestJSON-472565240 tempest-DeleteServersTestJSON-472565240-project-member] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1109.621232] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1109.621631] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.621842] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.621984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.622230] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.622406] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.622496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.622592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.622821] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.622908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.623017] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.130985] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.131370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.131370] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.131586] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.131725] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.132036] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.132158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.132225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.132414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.132500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.132597] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 1110.161757] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.162037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.162162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.162473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.162715] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.171896] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 1110.578205] env[70006]: INFO networking_nsxv3.common.synchronization [req-830081bc-78c5-403f-b76d-3c5cb203352e req-b7c5a44f-9ed8-4638-9161-a6eba9d6cf53 tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_members [ 1110.578860] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_members [ 1110.579228] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1869c6-76a1-476b-ae81-d81b81b97f5a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.579383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.579473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.579755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.579955] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.580485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.580607] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.580831] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.580965] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.581120] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.938187] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c in Status: SUCCESS [ 1110.938187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.036871] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.036871] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.036871] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.036871] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.036871] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.036871] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.036871] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.038752] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.039194] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.039511] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.039974] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.040208] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.040382] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.040538] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.041020] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.041238] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.063907] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.064109] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1111.064312] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.064475] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.064794] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-4d8f0295-7d55-4b26-803e-5f289211ed13 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.064977] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-4d8f0295-7d55-4b26-803e-5f289211ed13" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.065118] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-4d8f0295-7d55-4b26-803e-5f289211ed13" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.065464] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-4d8f0295-7d55-4b26-803e-5f289211ed13" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.065609] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d8f0295-7d55-4b26-803e-5f289211ed13',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.082925] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.083186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.083271] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.083545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.083695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.083960] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.084102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.084190] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.084385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.084470] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.084558] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a already deleted. [ 1111.084640] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.568525] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.568525] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.568954] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.569138] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.569216] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.569392] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 4d8f0295-7d55-4b26-803e-5f289211ed13 not found, creating... [ 1111.569706] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.569884] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.570026] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.570312] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.570481] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.571063] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.571063] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.571265] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.571359] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.571504] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.571649] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 4d8f0295-7d55-4b26-803e-5f289211ed13 is going to be created. [ 1111.604038] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.604315] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.604450] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.604794] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.604983] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.605234] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-4d8f0295-7d55-4b26-803e-5f289211ed13" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.187995] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 1112.188257] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 deletion is rescheduled due to dependency. [ 1112.188257] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.820328] env[70006]: INFO networking_nsxv3.common.synchronization [req-830081bc-78c5-403f-b76d-3c5cb203352e req-a2388893-5135-43dd-8941-61967e678035 service nova] Enqueued Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_rules [ 1112.820599] env[70006]: INFO networking_nsxv3.common.synchronization [req-830081bc-78c5-403f-b76d-3c5cb203352e req-a2388893-5135-43dd-8941-61967e678035 service nova] Enqueued Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_members [ 1112.820673] env[70006]: INFO networking_nsxv3.common.synchronization [req-830081bc-78c5-403f-b76d-3c5cb203352e req-a2388893-5135-43dd-8941-61967e678035 service nova] Enqueued Resource ID: 4d8f0295-7d55-4b26-803e-5f289211ed13 with Priority: HIGHEST for action port [ 1112.821322] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_rules [ 1112.824020] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_members [ 1112.824020] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d8f0295-7d55-4b26-803e-5f289211ed13 with Priority: HIGHEST for action port [ 1112.824020] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.824020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.824020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.824020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.824020] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.824020] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1869c6-76a1-476b-ae81-d81b81b97f5a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.824020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.824020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.824020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.824503] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.824503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.824503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.824503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.824503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.824503] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.828861] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d8f0295-7d55-4b26-803e-5f289211ed13 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.828861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d8f0295-7d55-4b26-803e-5f289211ed13" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.828861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d8f0295-7d55-4b26-803e-5f289211ed13" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.828861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d8f0295-7d55-4b26-803e-5f289211ed13" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.828861] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d8f0295-7d55-4b26-803e-5f289211ed13',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.328235] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1869c6-76a1-476b-ae81-d81b81b97f5a taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.328431] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.328596] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.330591] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d8f0295-7d55-4b26-803e-5f289211ed13 with status ACTIVE [ 1113.330591] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.330591] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.330591] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.330591] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.330591] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.330912] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.330912] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.330912] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.331045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.331092] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.331261] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.331347] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.331404] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.331571] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.331652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.331796] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d8f0295-7d55-4b26-803e-5f289211ed13 is going to be updated. [ 1113.352403] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.352607] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.352607] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.352783] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.352916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.353127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d8f0295-7d55-4b26-803e-5f289211ed13" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.834931] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.337557] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.337727] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.337804] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.338049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.338146] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.338245] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a is going to be created. [ 1114.363445] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.363720] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.363720] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.363899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.364057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.374655] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a in Status: UNINITIALIZED for 2s [ 1116.304208] env[70006]: INFO networking_nsxv3.common.synchronization [req-dffbea48-64ff-4948-9780-80fa21c26503 req-e46416cd-2c10-47be-8f71-ff710f6759e1 tempest-ServerActionsTestJSON-71305913 tempest-ServerActionsTestJSON-71305913-project-member] Enqueued Resource ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 with Priority: HIGHEST for action security_group_members [ 1116.309128] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 with Priority: HIGHEST for action security_group_members [ 1116.309128] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-15b2f848-e9f8-46b8-b9dc-b82509a3b126 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.309128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.309128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.309128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.309128] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.309128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.309128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.309128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.309128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.309128] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15b2f848-e9f8-46b8-b9dc-b82509a3b126',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.398594] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a in Status: SUCCESS [ 1116.398838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.399411] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.399646] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.399847] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.400041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.400118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.400285] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.400368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.400454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.400543] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.814675] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.814675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.814675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.814675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.814675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.814675] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.814675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.814675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.814675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.814675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.814675] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 is going to be updated. [ 1116.844558] env[70006]: INFO networking_nsxv3.common.synchronization [req-f320bd8a-e482-4541-9df9-cbd86779d271 req-9fd83b8d-a85b-4adf-bc66-d0c9a88e3e1c tempest-ServersTestFqdnHostnames-1659575620 tempest-ServersTestFqdnHostnames-1659575620-project-member] Enqueued Resource ID: beef0235-0372-4fe8-a0e3-e4255271d6ce with Priority: HIGHEST for action security_group_members [ 1116.844692] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beef0235-0372-4fe8-a0e3-e4255271d6ce with Priority: HIGHEST for action security_group_members [ 1116.844968] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-beef0235-0372-4fe8-a0e3-e4255271d6ce taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.846235] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.846335] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.846564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.846775] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.846949] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.847075] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.847288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.849095] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.849095] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('beef0235-0372-4fe8-a0e3-e4255271d6ce',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.851201] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.851617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.851617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.851722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.851911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.867371] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 in Status: IN_PROGRESS for 2s [ 1116.903675] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.350895] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.350895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.350895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.350895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.350895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.350895] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.350895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.350895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.350895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.350895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.351550] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beef0235-0372-4fe8-a0e3-e4255271d6ce is going to be updated. [ 1117.383898] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.384079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.384123] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.384913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.384913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.394256] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beef0235-0372-4fe8-a0e3-e4255271d6ce in Status: IN_PROGRESS for 2s [ 1117.405708] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb1869c6-76a1-476b-ae81-d81b81b97f5a: rpc.has_security_group_logging(os_id): False [ 1117.423984] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.424291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.424376] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.424564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.424656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.425622] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.425812] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.425887] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.426073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.426160] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.426284] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a is going to be created. [ 1117.498173] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.498173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.498173] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.498419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.498634] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.510735] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a in Status: IN_PROGRESS for 2s [ 1118.881585] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 in Status: SUCCESS [ 1118.881585] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 deletion is rescheduled due to dependency. [ 1118.881585] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.015917] env[70006]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1119.015917] env[70006]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] NSXv3 Agent Agent loop - iteration:2 started [ 1119.166029] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-439 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.166292] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-439" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.166442] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-439" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.166765] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-439" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.167082] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.167264] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.167392] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.167633] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.167802] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.168030] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1119.168164] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1119.168292] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1119.168404] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1119.168535] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1119.168799] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1119.168799] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1119.195233] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1119.195402] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1119.195544] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1119.195736] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-439" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.196858] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-d8aacd8d-2fc2-477b-9d82-e101e20b0132 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.196858] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.196858] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.196858] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.196858] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8aacd8d-2fc2-477b-9d82-e101e20b0132',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.407653] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beef0235-0372-4fe8-a0e3-e4255271d6ce in Status: SUCCESS [ 1119.407653] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beef0235-0372-4fe8-a0e3-e4255271d6ce deletion is rescheduled due to dependency. [ 1119.407653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.522315] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a in Status: SUCCESS [ 1119.522364] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.700476] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.700920] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.701103] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.701425] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.701686] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.701995] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.702277] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.702391] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.702637] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.702782] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.703139] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.703301] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.703422] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.703646] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.703786] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.703932] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: d8aacd8d-2fc2-477b-9d82-e101e20b0132 is going to be updated. [ 1119.718292] env[70006]: INFO networking_nsxv3.common.synchronization [None req-0c18950c-8360-416a-a1bc-c12e8448ccde None None] Enqueued Resource ID: 1b26425b-7cc1-466c-a3fb-7c3cacbd1a2c with Priority: HIGHEST for action port [ 1119.718292] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b26425b-7cc1-466c-a3fb-7c3cacbd1a2c with Priority: HIGHEST for action port [ 1119.718616] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b26425b-7cc1-466c-a3fb-7c3cacbd1a2c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.718740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b26425b-7cc1-466c-a3fb-7c3cacbd1a2c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.718789] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b26425b-7cc1-466c-a3fb-7c3cacbd1a2c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.719593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b26425b-7cc1-466c-a3fb-7c3cacbd1a2c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.719593] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b26425b-7cc1-466c-a3fb-7c3cacbd1a2c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.725578] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.725836] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.725942] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.726268] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.726488] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.726719] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.221498] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b26425b-7cc1-466c-a3fb-7c3cacbd1a2c [ 1120.221787] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.221867] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.221914] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.222193] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.222285] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.222388] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b26425b-7cc1-466c-a3fb-7c3cacbd1a2c already deleted. [ 1120.222469] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b26425b-7cc1-466c-a3fb-7c3cacbd1a2c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.760997] env[70006]: INFO networking_nsxv3.common.synchronization [req-5f807ff5-7210-4577-90e7-61c263f59cc2 req-01a303a6-98af-4487-a569-f81cffbb1880 service nova] Enqueued Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_rules [ 1120.761215] env[70006]: INFO networking_nsxv3.common.synchronization [req-5f807ff5-7210-4577-90e7-61c263f59cc2 req-01a303a6-98af-4487-a569-f81cffbb1880 service nova] Enqueued Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_members [ 1120.761381] env[70006]: INFO networking_nsxv3.common.synchronization [req-5f807ff5-7210-4577-90e7-61c263f59cc2 req-01a303a6-98af-4487-a569-f81cffbb1880 service nova] Enqueued Resource ID: d8aacd8d-2fc2-477b-9d82-e101e20b0132 with Priority: HIGHEST for action port [ 1120.761591] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_rules [ 1120.761956] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_members [ 1120.761956] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8aacd8d-2fc2-477b-9d82-e101e20b0132 with Priority: HIGHEST for action port [ 1120.765039] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.765039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.765039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.765039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.765039] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.765669] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.765669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.765749] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.765887] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.766048] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.766802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.766802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.766960] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.767465] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.767465] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.768876] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8aacd8d-2fc2-477b-9d82-e101e20b0132 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.768876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.768876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.768876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.768876] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8aacd8d-2fc2-477b-9d82-e101e20b0132',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.798670] env[70006]: INFO networking_nsxv3.common.synchronization [None req-d42d097f-f49e-436f-a595-17d7cbd620bd tempest-ServersTestJSON-294753548 tempest-ServersTestJSON-294753548-project-member] Enqueued Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGHEST for action security_group_rules [ 1120.801445] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGHEST for action security_group_rules [ 1120.801445] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.801445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.801445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.801445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.801445] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52f8f7d9-4c0c-462c-8639-ee701cd7952b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.932020] env[70006]: INFO networking_nsxv3.common.synchronization [None req-4ba822e1-00d0-422e-aa76-9bf9e37d3c99 tempest-ServersTestJSON-294753548 tempest-ServersTestJSON-294753548-project-member] Enqueued Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGHEST for action security_group_rules [ 1120.933322] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGHEST for action security_group_rules [ 1120.933322] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.933322] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.270595] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.272323] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.272323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.272624] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8aacd8d-2fc2-477b-9d82-e101e20b0132 with status ACTIVE [ 1121.272624] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.272624] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.272748] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.272888] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.272976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.273786] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.273935] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.274056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.274200] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.274294] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.274522] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.277620] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.277700] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.277933] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.278078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.278252] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8aacd8d-2fc2-477b-9d82-e101e20b0132 is going to be updated. [ 1121.304186] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.304386] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.304386] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.304678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.304767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.304879] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8aacd8d-2fc2-477b-9d82-e101e20b0132" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.331482] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.331650] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.331650] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.331841] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.331927] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.332035] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b already deleted. [ 1121.332140] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.332303] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.332471] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.332571] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52f8f7d9-4c0c-462c-8639-ee701cd7952b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.781951] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.857998] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.858188] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.858264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.858503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.858600] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.858733] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b already deleted. [ 1121.858855] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.286122] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.286122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.286122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.286122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.286122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.286597] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 is going to be updated. [ 1122.324884] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.325122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.325122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.325514] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.325676] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.335435] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: IN_PROGRESS for 2s [ 1122.434768] env[70006]: INFO networking_nsxv3.common.synchronization [None req-047344a4-f3bb-41af-a9d9-089dae6e44df None None] Enqueued Resource ID: 8549072e-7cc0-4e10-95bb-745f32873297 with Priority: HIGHEST for action port [ 1122.435057] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8549072e-7cc0-4e10-95bb-745f32873297 with Priority: HIGHEST for action port [ 1122.435697] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-8549072e-7cc0-4e10-95bb-745f32873297 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.435973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8549072e-7cc0-4e10-95bb-745f32873297" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.435973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8549072e-7cc0-4e10-95bb-745f32873297" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.438151] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8549072e-7cc0-4e10-95bb-745f32873297" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.438254] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8549072e-7cc0-4e10-95bb-745f32873297',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.942017] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8549072e-7cc0-4e10-95bb-745f32873297 [ 1122.942253] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.942390] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.942468] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.942681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.942772] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.942918] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8549072e-7cc0-4e10-95bb-745f32873297 already deleted. [ 1122.942957] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8549072e-7cc0-4e10-95bb-745f32873297" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.048223] env[70006]: INFO networking_nsxv3.common.synchronization [req-89d2df96-1fff-4baa-9210-1e1c045d6365 req-daa0b6a5-682c-46f0-b6b7-8e11f0902d35 tempest-ServerMetadataNegativeTestJSON-7641013 tempest-ServerMetadataNegativeTestJSON-7641013-project-member] Enqueued Resource ID: 50796b58-8a93-4487-8eed-daf2f0262adc with Priority: HIGHEST for action security_group_members [ 1124.049127] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50796b58-8a93-4487-8eed-daf2f0262adc with Priority: HIGHEST for action security_group_members [ 1124.049569] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-50796b58-8a93-4487-8eed-daf2f0262adc taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.049779] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.049931] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.050617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.050617] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.050617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.050617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.051302] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.051302] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.051302] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50796b58-8a93-4487-8eed-daf2f0262adc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.346952] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: SUCCESS [ 1124.347228] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.347416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.347670] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.347885] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.348022] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.348097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.348311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.348392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.348504] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.348639] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.556891] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-286 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.557097] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-286" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.557231] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-286" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.558163] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-286" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.558963] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.560175] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.560175] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.560175] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.560175] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.561029] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.561029] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1124.561029] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1124.561029] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1124.561029] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.561283] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1124.561283] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1124.563714] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.563870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.563941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.564279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.564371] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.564582] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.564679] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.564739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.566016] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.566016] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.566016] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50796b58-8a93-4487-8eed-daf2f0262adc already deleted. [ 1124.566016] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.584963] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1124.585740] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1124.585740] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1124.585740] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-286" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.585882] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-19122bfb-7d13-4768-b8b7-fc77264b0743 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.585968] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-19122bfb-7d13-4768-b8b7-fc77264b0743" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.586075] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-19122bfb-7d13-4768-b8b7-fc77264b0743" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.586424] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-19122bfb-7d13-4768-b8b7-fc77264b0743" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.586590] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19122bfb-7d13-4768-b8b7-fc77264b0743',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.851113] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.851357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.851357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.851522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.851685] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.851806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.851856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.851982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.852083] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.852197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.852373] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.852466] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.852525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.852669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.852803] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.852892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.852951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.853108] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.853184] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.853312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.853358] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.089384] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.089718] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.089809] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.090124] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.090303] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.090463] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 19122bfb-7d13-4768-b8b7-fc77264b0743 not found, creating... [ 1125.090749] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.090914] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.091051] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.091303] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.091447] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.091734] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.091890] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.092015] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.092364] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.092540] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.092677] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 19122bfb-7d13-4768-b8b7-fc77264b0743 is going to be created. [ 1125.115042] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.115042] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.115042] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.115319] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.115494] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.115635] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-19122bfb-7d13-4768-b8b7-fc77264b0743" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.357039] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85d75a9b-90ae-4f22-b7a1-48280a25caf8: rpc.has_security_group_logging(os_id): False [ 1125.376927] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.377147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.377147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.377362] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.377457] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.377656] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.377756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.377818] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.377972] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.378059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.378243] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.378356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.378461] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.378622] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.378728] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.379082] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.379239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.379315] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.379465] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.379540] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.379627] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 is going to be updated. [ 1125.452823] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.453102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.453102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.453260] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.453413] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.469629] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: IN_PROGRESS for 2s [ 1125.838593] env[70006]: INFO networking_nsxv3.common.synchronization [req-89d2df96-1fff-4baa-9210-1e1c045d6365 req-f79da2df-d422-4eca-8216-923cb87beddb service nova] Enqueued Resource ID: 50796b58-8a93-4487-8eed-daf2f0262adc with Priority: HIGHEST for action security_group_rules [ 1125.838593] env[70006]: INFO networking_nsxv3.common.synchronization [req-89d2df96-1fff-4baa-9210-1e1c045d6365 req-f79da2df-d422-4eca-8216-923cb87beddb service nova] Enqueued Resource ID: 50796b58-8a93-4487-8eed-daf2f0262adc with Priority: HIGHEST for action security_group_members [ 1125.838593] env[70006]: INFO networking_nsxv3.common.synchronization [req-89d2df96-1fff-4baa-9210-1e1c045d6365 req-f79da2df-d422-4eca-8216-923cb87beddb service nova] Enqueued Resource ID: 19122bfb-7d13-4768-b8b7-fc77264b0743 with Priority: HIGHEST for action port [ 1125.839104] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50796b58-8a93-4487-8eed-daf2f0262adc with Priority: HIGHEST for action security_group_rules [ 1125.839435] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50796b58-8a93-4487-8eed-daf2f0262adc with Priority: HIGHEST for action security_group_members [ 1125.840360] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19122bfb-7d13-4768-b8b7-fc77264b0743 with Priority: HIGHEST for action port [ 1125.840857] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50796b58-8a93-4487-8eed-daf2f0262adc taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.841062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.841157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.841495] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.841622] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50796b58-8a93-4487-8eed-daf2f0262adc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.843332] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-50796b58-8a93-4487-8eed-daf2f0262adc taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.843332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.843332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.843560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.843878] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.843982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.844120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.844364] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.844500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.844664] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50796b58-8a93-4487-8eed-daf2f0262adc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.846476] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-19122bfb-7d13-4768-b8b7-fc77264b0743 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.846635] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19122bfb-7d13-4768-b8b7-fc77264b0743" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.846738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19122bfb-7d13-4768-b8b7-fc77264b0743" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.846974] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19122bfb-7d13-4768-b8b7-fc77264b0743" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.847120] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19122bfb-7d13-4768-b8b7-fc77264b0743',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.349423] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-50796b58-8a93-4487-8eed-daf2f0262adc taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.349727] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.349815] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50796b58-8a93-4487-8eed-daf2f0262adc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.351808] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19122bfb-7d13-4768-b8b7-fc77264b0743 with status ACTIVE [ 1126.352037] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.352191] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.352270] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.352450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.352532] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.352714] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.352816] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.352875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.353021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.353138] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.353329] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.353448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.353518] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.353648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.353703] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.353754] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19122bfb-7d13-4768-b8b7-fc77264b0743 is going to be updated. [ 1126.388466] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.388717] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.388792] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.388987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.389147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.389336] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19122bfb-7d13-4768-b8b7-fc77264b0743" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.856041] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50796b58-8a93-4487-8eed-daf2f0262adc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.358883] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.359229] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.359229] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.359368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.359464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.359538] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50796b58-8a93-4487-8eed-daf2f0262adc is going to be created. [ 1127.387837] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.388124] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.388124] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.388291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.388463] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.400091] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50796b58-8a93-4487-8eed-daf2f0262adc in Status: UNINITIALIZED for 2s [ 1127.481896] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: SUCCESS [ 1127.482226] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.580865] env[70006]: INFO networking_nsxv3.common.synchronization [req-58cbf2ef-979c-4dc8-8dbc-54614d05c889 req-c0808c61-3d6c-4429-afff-a9ebf8ff4cdb tempest-ServerRescueTestJSON-144377210 tempest-ServerRescueTestJSON-144377210-project-member] Enqueued Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_members [ 1127.581521] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_members [ 1127.581846] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.581972] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.582056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.582450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.582992] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.582992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.582992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.582992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.583425] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.583425] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.085867] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.588059] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.092270] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.092481] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.092522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.092754] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.092869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.092949] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 is going to be updated. [ 1129.127886] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.128201] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.128201] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.128338] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.128474] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.139832] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 in Status: IN_PROGRESS for 2s [ 1129.411044] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50796b58-8a93-4487-8eed-daf2f0262adc in Status: SUCCESS [ 1129.411257] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.411431] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.411694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.411903] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.412051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.412126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.412299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.412381] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.412471] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.412583] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50796b58-8a93-4487-8eed-daf2f0262adc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.916216] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-50796b58-8a93-4487-8eed-daf2f0262adc taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.916216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.916216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.916216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.916216] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.916216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.916216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.916216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.916887] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.916887] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.916887] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-50796b58-8a93-4487-8eed-daf2f0262adc taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.916887] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.917035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.917095] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.917236] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.917339] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.917407] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.917589] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.917647] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.917732] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.917824] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50796b58-8a93-4487-8eed-daf2f0262adc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.420338] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50796b58-8a93-4487-8eed-daf2f0262adc: rpc.has_security_group_logging(os_id): False [ 1130.438940] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.439152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.439222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.439429] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.439525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.439745] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.439844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.439908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.440082] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.440157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.440345] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.440429] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.440485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.440628] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.440701] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.440874] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.440983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.441065] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.441213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.441285] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.441370] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50796b58-8a93-4487-8eed-daf2f0262adc is going to be created. [ 1130.497805] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.498350] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.498470] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.498664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.498817] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.509352] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50796b58-8a93-4487-8eed-daf2f0262adc in Status: IN_PROGRESS for 2s [ 1131.151048] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 in Status: SUCCESS [ 1131.151048] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.521940] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50796b58-8a93-4487-8eed-daf2f0262adc in Status: SUCCESS [ 1132.522309] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.583031] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1132.583140] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1134.627544] env[70006]: INFO networking_nsxv3.common.synchronization [req-d5e328be-8441-4768-a798-53b3d2c2d955 req-2e063649-75b4-467a-8697-ce8ee40e2782 tempest-ServersTestJSON-294753548 tempest-ServersTestJSON-294753548-project-member] Enqueued Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGHEST for action security_group_members [ 1134.628900] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGHEST for action security_group_members [ 1134.633686] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f8f7d9-4c0c-462c-8639-ee701cd7952b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.633686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.633686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.633686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.633686] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.633686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.633686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.633686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.633686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.633686] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52f8f7d9-4c0c-462c-8639-ee701cd7952b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.068971] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.069165] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-188" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.069306] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-188" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.069656] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-188" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.069931] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.071467] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.071673] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.071933] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.072111] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.072341] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.072486] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.072572] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.072684] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.072797] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.072917] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.073203] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.094393] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.094574] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1135.094746] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.094936] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-188" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.095359] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-cc3af4a9-2d59-4b89-975c-87e4a5e6d939 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.099215] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-cc3af4a9-2d59-4b89-975c-87e4a5e6d939" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.099215] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-cc3af4a9-2d59-4b89-975c-87e4a5e6d939" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.099504] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-cc3af4a9-2d59-4b89-975c-87e4a5e6d939" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.099658] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc3af4a9-2d59-4b89-975c-87e4a5e6d939',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.135675] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.135876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.135971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.136215] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.136333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.136536] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.136709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.136709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.136838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.136913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.136997] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b already deleted. [ 1135.137101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.602324] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.606384] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.606384] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.606384] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.606384] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.606384] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port cc3af4a9-2d59-4b89-975c-87e4a5e6d939 not found, creating... [ 1135.606384] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.606384] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.606384] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.606384] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.606384] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.606831] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.606831] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.606831] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.606831] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.606831] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.606831] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: cc3af4a9-2d59-4b89-975c-87e4a5e6d939 is going to be created. [ 1135.632904] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.633447] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.633447] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.633616] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.633911] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.634306] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-cc3af4a9-2d59-4b89-975c-87e4a5e6d939" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.802316] env[70006]: INFO networking_nsxv3.common.synchronization [req-d5e328be-8441-4768-a798-53b3d2c2d955 req-dbbbfae8-7535-430e-8eab-4d9559e9d2c6 service nova] Enqueued Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGHEST for action security_group_rules [ 1136.802676] env[70006]: INFO networking_nsxv3.common.synchronization [req-d5e328be-8441-4768-a798-53b3d2c2d955 req-dbbbfae8-7535-430e-8eab-4d9559e9d2c6 service nova] Enqueued Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGHEST for action security_group_members [ 1136.802724] env[70006]: INFO networking_nsxv3.common.synchronization [req-d5e328be-8441-4768-a798-53b3d2c2d955 req-dbbbfae8-7535-430e-8eab-4d9559e9d2c6 service nova] Enqueued Resource ID: cc3af4a9-2d59-4b89-975c-87e4a5e6d939 with Priority: HIGHEST for action port [ 1136.802946] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGHEST for action security_group_rules [ 1136.803095] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGHEST for action security_group_members [ 1136.803198] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3af4a9-2d59-4b89-975c-87e4a5e6d939 with Priority: HIGHEST for action port [ 1136.803808] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.803942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.804078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.804411] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.804543] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52f8f7d9-4c0c-462c-8639-ee701cd7952b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.805788] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f8f7d9-4c0c-462c-8639-ee701cd7952b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.805912] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.805983] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.806178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.806416] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.806551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.806603] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.806739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.806849] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.806987] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52f8f7d9-4c0c-462c-8639-ee701cd7952b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.807711] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc3af4a9-2d59-4b89-975c-87e4a5e6d939 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.807820] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc3af4a9-2d59-4b89-975c-87e4a5e6d939" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.807899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc3af4a9-2d59-4b89-975c-87e4a5e6d939" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.808150] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc3af4a9-2d59-4b89-975c-87e4a5e6d939" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.808267] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc3af4a9-2d59-4b89-975c-87e4a5e6d939',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.068496] env[70006]: INFO networking_nsxv3.common.synchronization [req-2913cab7-f9c4-42a7-b49c-50d66df3b158 req-a7be75c9-5b26-419d-a515-1349e1c10e84 tempest-ServersTestJSON-1431904245 tempest-ServersTestJSON-1431904245-project-member] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1137.069872] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1137.073456] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.073593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.073659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.073856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.074020] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.074125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.074186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.074351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.074405] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.074500] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.310429] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f8f7d9-4c0c-462c-8639-ee701cd7952b taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.310568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.310763] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52f8f7d9-4c0c-462c-8639-ee701cd7952b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.311698] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc3af4a9-2d59-4b89-975c-87e4a5e6d939 with status ACTIVE [ 1137.311884] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.311996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.312081] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.312382] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.312494] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.312666] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.312761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.312941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.313011] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.313057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.313242] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.313385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.313385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.313547] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.313598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.313663] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc3af4a9-2d59-4b89-975c-87e4a5e6d939 is going to be updated. [ 1137.346542] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.346702] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.347428] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.347428] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.347428] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.347627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc3af4a9-2d59-4b89-975c-87e4a5e6d939" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.577149] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.582218] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-592 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.582543] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.582674] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.582947] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.583222] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.583398] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.583520] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.583766] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.583928] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.584467] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1137.584467] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1137.584586] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1137.584625] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1137.584708] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1137.584811] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1137.584940] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1137.605750] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1137.605750] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1137.605750] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1137.605750] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-592" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.605750] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-3eb52fcc-22d7-430e-9fd7-54b925e05cec taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.605750] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-3eb52fcc-22d7-430e-9fd7-54b925e05cec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.606230] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-3eb52fcc-22d7-430e-9fd7-54b925e05cec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.606269] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-3eb52fcc-22d7-430e-9fd7-54b925e05cec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.606926] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eb52fcc-22d7-430e-9fd7-54b925e05cec',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.816651] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52f8f7d9-4c0c-462c-8639-ee701cd7952b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.079391] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.111523] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.111523] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.111523] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.111523] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.111523] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.111523] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 3eb52fcc-22d7-430e-9fd7-54b925e05cec not found, creating... [ 1138.111523] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.111523] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.111523] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.111523] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.111523] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.112027] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.112027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.112027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.112027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.112027] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.112027] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 3eb52fcc-22d7-430e-9fd7-54b925e05cec is going to be created. [ 1138.135454] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.135454] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.135454] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.135454] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.135763] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.135987] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-3eb52fcc-22d7-430e-9fd7-54b925e05cec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.318883] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.319128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.319128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.319363] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.319452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.319554] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b is going to be created. [ 1138.348654] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.348841] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.348921] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.349155] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.349315] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.361458] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b in Status: UNINITIALIZED for 2s [ 1138.584837] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.584837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.584837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.584837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.584837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.584837] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 1138.657109] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.657275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.657350] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.657608] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.657799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.667987] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 1139.024039] env[70006]: INFO networking_nsxv3.common.synchronization [req-2913cab7-f9c4-42a7-b49c-50d66df3b158 req-cc71b5ab-8c55-4091-abae-cb6dd6ef9340 service nova] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_rules [ 1139.024039] env[70006]: INFO networking_nsxv3.common.synchronization [req-2913cab7-f9c4-42a7-b49c-50d66df3b158 req-cc71b5ab-8c55-4091-abae-cb6dd6ef9340 service nova] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1139.024039] env[70006]: INFO networking_nsxv3.common.synchronization [req-2913cab7-f9c4-42a7-b49c-50d66df3b158 req-cc71b5ab-8c55-4091-abae-cb6dd6ef9340 service nova] Enqueued Resource ID: 3eb52fcc-22d7-430e-9fd7-54b925e05cec with Priority: HIGHEST for action port [ 1139.024608] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_rules [ 1139.025708] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1139.025708] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eb52fcc-22d7-430e-9fd7-54b925e05cec with Priority: HIGHEST for action port [ 1139.025708] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.026101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.026101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.026101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.026101] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.027055] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.027423] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.027423] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-3eb52fcc-22d7-430e-9fd7-54b925e05cec taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.027423] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3eb52fcc-22d7-430e-9fd7-54b925e05cec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.027576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3eb52fcc-22d7-430e-9fd7-54b925e05cec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.027624] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3eb52fcc-22d7-430e-9fd7-54b925e05cec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.028256] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eb52fcc-22d7-430e-9fd7-54b925e05cec',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.518913] env[70006]: INFO networking_nsxv3.common.synchronization [req-7b240801-af8e-459d-a6b7-9a12a33bf89e req-2e40792b-f7ad-4370-8999-27c0c918b98e tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_members [ 1139.519751] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_members [ 1139.520661] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1869c6-76a1-476b-ae81-d81b81b97f5a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.520818] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.520897] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.521116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.521290] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.521393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.521459] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.521726] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.521814] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.521910] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.529124] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.529327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.532247] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3eb52fcc-22d7-430e-9fd7-54b925e05cec with status ACTIVE [ 1139.532247] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.532247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.532247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.532247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.532817] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.532817] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.532817] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.532817] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.532817] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.533036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.533104] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.533178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.533249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.533533] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.533533] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.533665] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3eb52fcc-22d7-430e-9fd7-54b925e05cec is going to be updated. [ 1139.561361] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.561573] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.561659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.561968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.562198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.562587] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3eb52fcc-22d7-430e-9fd7-54b925e05cec" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.891975] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.892194] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.892398] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.892710] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.893029] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.893192] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.893317] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.893542] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.893690] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.893901] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.894026] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1139.894142] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1139.894254] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1139.894369] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.894511] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1139.894662] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.918137] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.918137] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1139.918137] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.918137] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.918653] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-dcb5c6dd-7799-4712-91fd-86a53ac56170 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.918951] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-dcb5c6dd-7799-4712-91fd-86a53ac56170" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.919209] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-dcb5c6dd-7799-4712-91fd-86a53ac56170" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.919735] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-dcb5c6dd-7799-4712-91fd-86a53ac56170" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.919988] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcb5c6dd-7799-4712-91fd-86a53ac56170',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.023658] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.373181] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b in Status: SUCCESS [ 1140.373599] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.373642] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.374560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.374560] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.374560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.374560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.374560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.374560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.374560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.374936] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52f8f7d9-4c0c-462c-8639-ee701cd7952b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.423982] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.424240] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.424392] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.424802] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.424899] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.425038] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port dcb5c6dd-7799-4712-91fd-86a53ac56170 not found, creating... [ 1140.425323] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.425513] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.425641] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.425836] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.425977] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.426277] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.426437] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.426570] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.426774] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.426911] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.427067] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: dcb5c6dd-7799-4712-91fd-86a53ac56170 is going to be created. [ 1140.447446] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.447607] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.447700] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.447993] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.448244] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.448482] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-dcb5c6dd-7799-4712-91fd-86a53ac56170" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.526092] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.679637] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 1140.679882] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.680051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.680349] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.680625] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.681464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.681464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.681464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.681464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.681464] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.879718] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52f8f7d9-4c0c-462c-8639-ee701cd7952b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.029196] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.029196] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.029196] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.029196] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.029631] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.029631] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a is going to be updated. [ 1141.059067] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.059067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.059067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.059311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.059431] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.069721] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a in Status: IN_PROGRESS for 2s [ 1141.184409] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.328539] env[70006]: INFO networking_nsxv3.common.synchronization [req-5b8ef192-c61f-45f3-a144-fffcaabb99fb req-c8d374bb-c055-44fd-a7cd-39ace0ee2380 tempest-ServerMetadataNegativeTestJSON-7641013 tempest-ServerMetadataNegativeTestJSON-7641013-project-member] Enqueued Resource ID: 50796b58-8a93-4487-8eed-daf2f0262adc with Priority: HIGHEST for action security_group_members [ 1141.328539] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50796b58-8a93-4487-8eed-daf2f0262adc with Priority: HIGHEST for action security_group_members [ 1141.328539] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-50796b58-8a93-4487-8eed-daf2f0262adc taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.328539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.328539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.329272] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.329630] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.329914] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.330133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.331632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.331632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.331632] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50796b58-8a93-4487-8eed-daf2f0262adc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.381315] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52f8f7d9-4c0c-462c-8639-ee701cd7952b: rpc.has_security_group_logging(os_id): False [ 1141.399893] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.400041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.400103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.400368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.400519] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.400671] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.400765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.400824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.400982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.401072] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.401336] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b is going to be created. [ 1141.506773] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.507090] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.507090] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.507268] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.507460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.525155] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b in Status: IN_PROGRESS for 2s [ 1141.686049] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.818952] env[70006]: INFO networking_nsxv3.common.synchronization [req-7b240801-af8e-459d-a6b7-9a12a33bf89e req-36dbb2f1-061a-4d76-9615-e09701d55c6c service nova] Enqueued Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_rules [ 1141.818952] env[70006]: INFO networking_nsxv3.common.synchronization [req-7b240801-af8e-459d-a6b7-9a12a33bf89e req-36dbb2f1-061a-4d76-9615-e09701d55c6c service nova] Enqueued Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_members [ 1141.818952] env[70006]: INFO networking_nsxv3.common.synchronization [req-7b240801-af8e-459d-a6b7-9a12a33bf89e req-36dbb2f1-061a-4d76-9615-e09701d55c6c service nova] Enqueued Resource ID: dcb5c6dd-7799-4712-91fd-86a53ac56170 with Priority: HIGHEST for action port [ 1141.818952] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_rules [ 1141.818952] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_members [ 1141.818952] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcb5c6dd-7799-4712-91fd-86a53ac56170 with Priority: HIGHEST for action port [ 1141.818952] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.818952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.818952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.818952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.818952] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.818952] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1869c6-76a1-476b-ae81-d81b81b97f5a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.818952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.818952] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcb5c6dd-7799-4712-91fd-86a53ac56170 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.818952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcb5c6dd-7799-4712-91fd-86a53ac56170" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.818952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcb5c6dd-7799-4712-91fd-86a53ac56170" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.818952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcb5c6dd-7799-4712-91fd-86a53ac56170" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.818952] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcb5c6dd-7799-4712-91fd-86a53ac56170',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.832763] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.832956] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.833070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.833981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.833981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.833981] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.833981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.834199] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.834199] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.834308] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.834370] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50796b58-8a93-4487-8eed-daf2f0262adc is going to be updated. [ 1141.872577] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.872577] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.872577] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.872577] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.872577] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.887828] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50796b58-8a93-4487-8eed-daf2f0262adc in Status: IN_PROGRESS for 2s [ 1142.190595] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.190777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.190832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.191114] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.191218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.191324] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 1142.244456] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1869c6-76a1-476b-ae81-d81b81b97f5a taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.244655] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.244863] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dcb5c6dd-7799-4712-91fd-86a53ac56170 with status ACTIVE [ 1142.245069] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.245180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.245245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.245473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.245564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.245731] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.245827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.245878] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.246047] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.246129] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.246322] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.246417] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.246481] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.246624] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.246700] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.246803] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dcb5c6dd-7799-4712-91fd-86a53ac56170 is going to be updated. [ 1142.266715] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.266975] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.267075] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.267255] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.267402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.277185] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 1142.295798] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.295991] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.296036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.296583] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.296740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.296955] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcb5c6dd-7799-4712-91fd-86a53ac56170" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.080479] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a in Status: SUCCESS [ 1143.080817] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.080882] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.081148] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.081343] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.081464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.081529] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.081750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.081803] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.081863] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.540132] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b in Status: SUCCESS [ 1143.540132] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.584866] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.734086] env[70006]: INFO networking_nsxv3.common.synchronization [req-8d681da8-7f2e-4a60-b42a-6e809f14c81c req-85257441-9478-4fd9-8ef7-ca16661729fd tempest-ServerRescueTestJSON-144377210 tempest-ServerRescueTestJSON-144377210-project-member] Enqueued Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_members [ 1143.735825] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGHEST for action security_group_members [ 1143.736521] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.736521] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.736521] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.737875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.737875] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.737875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.737875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.737875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.737875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.737875] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.898235] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50796b58-8a93-4487-8eed-daf2f0262adc in Status: SUCCESS [ 1143.898235] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50796b58-8a93-4487-8eed-daf2f0262adc deletion is rescheduled due to dependency. [ 1143.898235] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.088403] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.206589] env[70006]: INFO networking_nsxv3.common.synchronization [req-ba13453e-ee86-4ebd-8ae2-6e4918c68004 req-8115f8bc-6ba3-4065-bb2d-8791501cf674 tempest-DeleteServersTestJSON-472565240 tempest-DeleteServersTestJSON-472565240-project-member] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1144.207198] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1144.207541] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.207701] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.207858] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.208011] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.208537] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.208537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.208537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.208537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.208689] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.208689] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.239634] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.239785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.239832] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.240077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.240178] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.240394] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.240493] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.240555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.240707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.240782] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.240867] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 is going to be updated. [ 1144.271737] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.271930] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.271994] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.272239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.272403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.283340] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 in Status: IN_PROGRESS for 2s [ 1144.287761] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 1144.287943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.289356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.289356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.289356] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.289356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.289356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.289356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.289356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.289356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.289356] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.591351] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.591504] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.591579] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.592058] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.592058] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.592058] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a is going to be updated. [ 1144.621669] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.621823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.622153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.622546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.622751] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.625898] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.626100] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.626228] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.626490] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.626759] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.626974] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.627149] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.627378] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.627528] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.627744] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.627862] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1144.628187] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1144.628187] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1144.628254] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.628573] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1144.628573] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1144.634168] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a in Status: IN_PROGRESS for 2s [ 1144.646884] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1144.647110] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1144.647263] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1144.647444] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-414" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.647771] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-43a074aa-e66b-4258-8c74-fae23dca9c71 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.647947] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-43a074aa-e66b-4258-8c74-fae23dca9c71" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.648097] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-43a074aa-e66b-4258-8c74-fae23dca9c71" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.648458] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-43a074aa-e66b-4258-8c74-fae23dca9c71" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.648607] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43a074aa-e66b-4258-8c74-fae23dca9c71',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.712968] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.712968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.712968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.712968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.712968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.712968] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.712968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.712968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.712968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.712968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.712968] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 1144.739035] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.739035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.739035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.739035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.739274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.748010] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 1144.791888] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.792123] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.792442] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.792509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.792781] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.792940] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.793067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.793284] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.793390] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.793494] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.793725] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.793853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.793930] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.794099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.794270] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.794372] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.794433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.794610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.794699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.794804] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.794890] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.151230] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.151521] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.151650] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.151957] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.152188] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.152483] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 43a074aa-e66b-4258-8c74-fae23dca9c71 not found, creating... [ 1145.152764] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.152982] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.153139] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.153465] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.153635] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.154515] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.154515] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.154515] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.154750] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.154750] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.154975] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 43a074aa-e66b-4258-8c74-fae23dca9c71 is going to be created. [ 1145.191849] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.192129] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.192266] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.192845] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.192982] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.193206] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-43a074aa-e66b-4258-8c74-fae23dca9c71" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.299904] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b2723f9-b1dc-419e-b339-13aae985829f: rpc.has_security_group_logging(os_id): False [ 1145.340503] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.340769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.340882] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.341234] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.341482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.341697] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.341913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.341980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.342269] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.342492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.342836] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.343010] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.343130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.343380] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.343522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.343856] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.344034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.344134] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.344459] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.344538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.344681] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 1145.425606] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.425790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.425825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.426044] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.426198] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.440820] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 1145.930484] env[70006]: INFO networking_nsxv3.common.synchronization [req-ba13453e-ee86-4ebd-8ae2-6e4918c68004 req-eb18f033-f1c5-4a46-b64a-9aafff1894b0 service nova] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_rules [ 1145.930484] env[70006]: INFO networking_nsxv3.common.synchronization [req-ba13453e-ee86-4ebd-8ae2-6e4918c68004 req-eb18f033-f1c5-4a46-b64a-9aafff1894b0 service nova] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1145.930484] env[70006]: INFO networking_nsxv3.common.synchronization [req-ba13453e-ee86-4ebd-8ae2-6e4918c68004 req-eb18f033-f1c5-4a46-b64a-9aafff1894b0 service nova] Enqueued Resource ID: 43a074aa-e66b-4258-8c74-fae23dca9c71 with Priority: HIGHEST for action port [ 1145.930833] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_rules [ 1145.931426] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1145.931571] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a074aa-e66b-4258-8c74-fae23dca9c71 with Priority: HIGHEST for action port [ 1145.931935] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.932105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.932166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.932435] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.932538] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.933578] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.933688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.933901] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-43a074aa-e66b-4258-8c74-fae23dca9c71 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.934036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43a074aa-e66b-4258-8c74-fae23dca9c71" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.934105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43a074aa-e66b-4258-8c74-fae23dca9c71" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.934266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43a074aa-e66b-4258-8c74-fae23dca9c71" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.934375] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43a074aa-e66b-4258-8c74-fae23dca9c71',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.294563] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 in Status: SUCCESS [ 1146.294863] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 deletion is rescheduled due to dependency. [ 1146.294895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.436764] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.436882] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.437246] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43a074aa-e66b-4258-8c74-fae23dca9c71 with status ACTIVE [ 1146.437459] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.437631] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.437676] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.437855] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.437941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.438126] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.438225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.438283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.438514] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.438514] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.438672] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.438766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.438855] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.438994] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.439065] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.439158] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43a074aa-e66b-4258-8c74-fae23dca9c71 is going to be updated. [ 1146.477015] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.477015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.477015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.477199] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.477543] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.477543] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43a074aa-e66b-4258-8c74-fae23dca9c71" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.645274] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a in Status: SUCCESS [ 1146.645274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.645274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.645274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.645274] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.645274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.645274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.645274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.645274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.645274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.645274] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.762067] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 1146.762067] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 deletion is rescheduled due to dependency. [ 1146.762067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.762067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.762067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.762067] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.762067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.762067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.762067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.762067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.762067] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.147533] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.264169] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.456795] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 1147.457082] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.653476] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb1869c6-76a1-476b-ae81-d81b81b97f5a: rpc.has_security_group_logging(os_id): False [ 1147.671661] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.671851] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.671851] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.672185] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.672337] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.672693] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.672834] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.672873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.673019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.673099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.673183] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a is going to be updated. [ 1147.743202] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.743202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.743202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.743202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.743202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.758612] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a in Status: IN_PROGRESS for 2s [ 1147.767150] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.272273] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.272273] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.272273] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.272273] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.272273] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.272273] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 1148.305212] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.305384] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.305440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.305636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.305790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.317920] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 1149.780217] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a in Status: SUCCESS [ 1149.780217] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.328347] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 1150.328570] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.328740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.328956] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.329165] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.329282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.329348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.329493] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.329574] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.329658] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.329804] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.836045] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.836045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.836045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.837604] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.837604] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.837604] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.837604] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.837786] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.837814] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.837912] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.838103] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.838204] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.838264] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.838414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.838546] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.838821] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.838821] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.838944] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.839147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.839238] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.839328] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.932616] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1150.933033] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1151.346803] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5: rpc.has_security_group_logging(os_id): False [ 1151.372362] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.372658] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.372771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.373011] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.373126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.373390] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.373674] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.373766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.373959] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.374063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.374615] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.374736] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.374881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.375078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.375164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.375369] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.375470] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.375534] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.375692] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.375771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.375859] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 1151.469826] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.470155] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.470278] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.470610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.470778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.496264] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 1153.515850] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 1153.516202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.754237] env[70006]: INFO networking_nsxv3.common.synchronization [req-64258412-f889-4b0c-bfa7-21a2a168e999 req-c1ec16b1-f736-4a7f-9d0d-131428ef098e tempest-ServersNegativeTestJSON-161729029 tempest-ServersNegativeTestJSON-161729029-project-member] Enqueued Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_members [ 1153.754786] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGHEST for action security_group_members [ 1153.755572] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.756379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.756379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.756379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.756379] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.756379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.756379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.756789] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.756916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.757111] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.953462] env[70006]: INFO networking_nsxv3.common.synchronization [None req-c600fb12-9456-4cdc-ad48-2c386de15f40 tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1153.954157] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1153.954576] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.954792] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.954884] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.955222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.955364] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.955475] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.955539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.955686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.955775] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.955873] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.263771] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.263771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.263771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.263771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.263771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.263771] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.263771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.263771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.263771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.263771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.263771] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 is going to be updated. [ 1154.293830] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.294042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.294042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.294327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.294430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.304408] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: IN_PROGRESS for 2s [ 1154.460136] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.460136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.460136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.460136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.460136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.460136] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.460136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.460136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.460136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.460136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.460665] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be updated. [ 1154.495040] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.495266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.495266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.495456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.495596] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.505691] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 1155.937961] env[70006]: INFO networking_nsxv3.common.synchronization [req-b913a56e-874d-4cd7-9cdb-5a7b97334335 req-7b8f4811-0e2c-40e3-b70f-8b0471576ac2 tempest-ServersTestJSON-1431904245 tempest-ServersTestJSON-1431904245-project-member] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1155.938848] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1155.939589] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.939589] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.939589] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.939775] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.939943] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.940118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.940227] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.940433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.940636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.940720] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.314501] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 in Status: SUCCESS [ 1156.314712] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 deletion is rescheduled due to dependency. [ 1156.314899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.443520] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.521707] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 1156.521892] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 deletion is rescheduled due to dependency. [ 1156.522017] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.945620] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.448922] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.448922] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.448922] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.448922] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.449167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.449167] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 1157.477134] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.477273] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.477351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.477578] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.477781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.488566] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 1159.500617] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 1159.500913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.939500] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1160.939798] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1162.995012] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.995357] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.995357] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.995607] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.995877] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.996714] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.996714] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.996714] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.996714] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.997027] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1162.997135] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1162.997296] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1162.997457] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1162.997588] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1162.997699] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1162.997838] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1163.021525] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1163.021744] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1163.021841] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1163.022040] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.022382] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-b209fd87-7748-481e-8262-5ec43c4a436b taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.022566] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.022762] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.023155] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.023316] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b209fd87-7748-481e-8262-5ec43c4a436b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.526078] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.526078] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.526078] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.526447] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.526617] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.526784] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port b209fd87-7748-481e-8262-5ec43c4a436b not found, creating... [ 1163.527071] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.527237] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.527360] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.527587] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.527732] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.528027] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.528190] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.528313] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.528526] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.528666] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.528809] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: b209fd87-7748-481e-8262-5ec43c4a436b is going to be created. [ 1163.548673] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.548895] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.549016] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.549320] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.549564] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.549860] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.223209] env[70006]: INFO networking_nsxv3.common.synchronization [req-fca506ee-be02-4f80-96f0-9cf9ffd3b144 req-bc09d6fe-59d4-4f46-892a-5cfe0068ad2f tempest-ServersTestJSON-1431904245 tempest-ServersTestJSON-1431904245-project-member] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1164.223209] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGHEST for action security_group_members [ 1164.223209] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.223209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.223209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.223209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.223209] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.223569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.223569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.223569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.223569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.223744] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.286765] env[70006]: INFO networking_nsxv3.common.synchronization [req-8662308a-4a45-43db-8717-c8c2eb32945c req-06666047-b536-4e70-884b-d5cb6321dd97 service nova] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_rules [ 1164.287088] env[70006]: INFO networking_nsxv3.common.synchronization [req-8662308a-4a45-43db-8717-c8c2eb32945c req-06666047-b536-4e70-884b-d5cb6321dd97 service nova] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1164.287368] env[70006]: INFO networking_nsxv3.common.synchronization [req-8662308a-4a45-43db-8717-c8c2eb32945c req-06666047-b536-4e70-884b-d5cb6321dd97 service nova] Enqueued Resource ID: b209fd87-7748-481e-8262-5ec43c4a436b with Priority: HIGHEST for action port [ 1164.287584] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_rules [ 1164.287716] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1164.287818] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b209fd87-7748-481e-8262-5ec43c4a436b with Priority: HIGHEST for action port [ 1164.289112] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.289112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.289112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.289246] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.289327] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.290096] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.290220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.290290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.290581] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.290581] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.290688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.290739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.290881] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.290965] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.291071] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.292155] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-b209fd87-7748-481e-8262-5ec43c4a436b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.292269] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.292523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.292523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.292593] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b209fd87-7748-481e-8262-5ec43c4a436b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.726973] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.726973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.727192] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.728412] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.728412] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.728412] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.728412] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.728412] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.728412] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.728412] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.728412] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be updated. [ 1164.755254] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.755557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.757354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.757695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.758358] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.768877] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: IN_PROGRESS for 2s [ 1164.794784] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.795498] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.795602] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.796061] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b209fd87-7748-481e-8262-5ec43c4a436b with status ACTIVE [ 1164.796061] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.796061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.796222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.796354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.796470] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.796914] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.796914] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.796914] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.797075] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.797558] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.797558] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.797558] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.797558] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.798397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.798397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.798397] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b209fd87-7748-481e-8262-5ec43c4a436b is going to be updated. [ 1164.824573] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.824722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.824816] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.825029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.825187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.825356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.943822] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.943822] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.943822] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.943822] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.944186] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.300967] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.452767] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.803532] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.803742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.803798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.804035] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.804131] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.804293] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be updated. [ 1165.830476] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.830781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.830869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.832631] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.832631] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.841403] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 1165.952834] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.982508] env[70006]: INFO networking_nsxv3.common.synchronization [req-42879cfb-ceb2-4b7e-9e78-ae536d398e30 req-5ce5547f-7025-46fa-b9c3-028d4734b3fc tempest-AttachVolumeShelveTestJSON-1969238173 tempest-AttachVolumeShelveTestJSON-1969238173-project-member] Enqueued Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_members [ 1165.986525] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGHEST for action security_group_members [ 1165.990133] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.990133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.990133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.990133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.990133] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.990133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.990133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.992667] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.992944] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.993217] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.454345] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1166.454682] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1166.496762] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.496762] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.496762] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.496979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.496979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.497200] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.497325] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.497460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.497630] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.497784] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.497964] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c is going to be updated. [ 1166.547761] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.547971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.548092] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.548410] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.548574] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.561578] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c in Status: IN_PROGRESS for 2s [ 1166.782124] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b2723f9-b1dc-419e-b339-13aae985829f in Status: SUCCESS [ 1166.782448] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f deletion is rescheduled due to dependency. [ 1166.782448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.385419] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.385625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.385625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.385824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.399178] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1167.400088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.401116] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1167.436194] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.436373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.436416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.436605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.446957] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.447629] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1167.447717] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1167.447819] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1167.483534] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.483534] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.483534] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.483534] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.484666] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.484859] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1167.550360] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.550506] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.550714] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.550953] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.551247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.551502] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1167.617301] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.617508] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.617508] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.617786] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.618068] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.618357] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:36. [ 1167.618463] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'52f8f7d9-4c0c-462c-8639-ee701cd7952b', '15b2f848-e9f8-46b8-b9dc-b82509a3b126', 'f3c6c493-02b2-4cc9-86d0-15e7a48daae4', '28b8ed16-99b8-40b6-8095-2254b0cf928c', 'beef0235-0372-4fe8-a0e3-e4255271d6ce', 'df5faca2-f036-4823-a1d7-4ca3af9ed4ba', '041bde4c-c513-4b39-85d4-3d543865b6f0', '85d75a9b-90ae-4f22-b7a1-48280a25caf8', 'f682c5f3-6947-4cf3-a94e-7b777b1efe4c', '88bcc035-9dc7-4401-b37d-3fe17bc7b0f6', 'a1a51886-1748-4f34-be32-1ba9c09de405', '50796b58-8a93-4487-8eed-daf2f0262adc', '4aa62458-e6a1-47ca-9f29-72a54d1dc002', '46e7bb0e-3b0b-455c-8638-3cb59c191bf9', '63af98c3-e3a7-4ddd-84ed-0fd58e3e4181', 'f885e47a-f0d6-416e-9871-7d36cac6dbc6', 'ed4cc3e0-52bb-498d-9f73-56ded2b5d090', 'a96b9fdf-0e4e-492b-ba29-5c5513d45f05', 'ec4d7bd2-dee8-4667-8923-366f583eec53', '2695bb32-670b-49f4-b84e-274269e20fe5', '7dabf6a4-a7d4-4bc7-a18c-73081fea1de5', 'bcb3911f-9d2b-45be-a214-581dc745aaa9', 'cefeff63-e154-425d-8ffe-56cc092db146', '946a4bb3-35a7-45bf-b93f-0879f8e48ab0', '6d10f346-7e60-4bf9-a322-b64cbffea871', '2d0a478f-3de2-453c-980b-25efdb42c355', 'e45746ed-781c-4f14-807a-e9e8876db03b', '5b2723f9-b1dc-419e-b339-13aae985829f', 'cb1869c6-76a1-476b-ae81-d81b81b97f5a', '8a4e3fb3-c949-45ee-b225-af03d5526168', '152fa45c-61d1-4b26-872b-ee9494b58bea', 'ce0190ac-bf23-4a10-82de-268e3bc82647', 'a5bdfda1-5bdc-410b-ab38-e2b0315faa59', 'a703014b-177b-46b0-a1e5-010ba0dfd415', 'b62110f9-4181-4c43-9e99-43fd5dff214d', '6541dc4e-5278-42ae-bed3-8ae1f828bb0f'} {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1167.618628] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1167.639588] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.639756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.639825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.640056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.640155] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.640284] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1167.640386] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1167.640436] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1167.706436] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.708079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.708079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.708079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.708266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.708445] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1167.708695] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1167.708806] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1167.708886] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1167.708951] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/36 resources of Type:Security Group Rules [ 1167.709040] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGH for action security_group_rules [ 1167.709288] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 with Priority: HIGH for action security_group_rules [ 1167.709362] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 with Priority: HIGH for action security_group_rules [ 1167.709507] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGH for action security_group_rules [ 1167.709612] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: beef0235-0372-4fe8-a0e3-e4255271d6ce with Priority: HIGH for action security_group_rules [ 1167.709680] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba with Priority: HIGH for action security_group_rules [ 1167.709745] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGH for action security_group_rules [ 1167.709922] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGH for action security_group_rules [ 1167.709986] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGH for action security_group_rules [ 1167.710059] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGH for action security_group_rules [ 1167.710207] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGH for action security_group_rules [ 1167.710287] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50796b58-8a93-4487-8eed-daf2f0262adc with Priority: HIGH for action security_group_rules [ 1167.710351] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGH for action security_group_rules [ 1167.710410] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGH for action security_group_rules [ 1167.710611] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 with Priority: HIGH for action security_group_rules [ 1167.710672] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 with Priority: HIGH for action security_group_rules [ 1167.710943] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 with Priority: HIGH for action security_group_rules [ 1167.711067] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGH for action security_group_rules [ 1167.711148] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ec4d7bd2-dee8-4667-8923-366f583eec53 with Priority: HIGH for action security_group_rules [ 1167.711242] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2695bb32-670b-49f4-b84e-274269e20fe5 with Priority: HIGH for action security_group_rules [ 1167.711369] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.852203] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 1167.852445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.852637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.853019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.853330] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.853531] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.853648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.853879] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.853974] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.854137] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.854264] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.357072] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.357303] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.357303] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.357537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.357718] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.357819] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.357891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.358055] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.358156] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.358246] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.358404] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.358498] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.358549] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.358684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.358833] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.358959] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.358959] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.359114] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.359189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.359271] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.359362] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.572638] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c in Status: SUCCESS [ 1168.573061] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c deletion is rescheduled due to dependency. [ 1168.573061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.862193] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcb3911f-9d2b-45be-a214-581dc745aaa9: rpc.has_security_group_logging(os_id): False [ 1168.881463] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.881637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.881732] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.882020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.902017] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.902329] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.902448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.902515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.902781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.902877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.903094] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.903194] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.903257] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.903412] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.903486] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.903662] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.903811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.903996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.904282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.904400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.904523] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be updated. [ 1168.966047] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.966240] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.966276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.966611] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.966840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.978869] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 1170.989522] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1170.989832] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=1 [ 1170.989832] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGH for action security_group_rules [ 1170.990021] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 with Priority: HIGH for action security_group_rules [ 1170.990021] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 with Priority: HIGH for action security_group_rules [ 1170.990097] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 with Priority: HIGH for action security_group_rules [ 1170.990166] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2695bb32-670b-49f4-b84e-274269e20fe5 with Priority: HIGH for action security_group_rules [ 1170.990258] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec4d7bd2-dee8-4667-8923-366f583eec53 with Priority: HIGH for action security_group_rules [ 1170.990349] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 with Priority: HIGH for action security_group_rules [ 1170.990438] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 with Priority: HIGH for action security_group_rules [ 1170.990528] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 with Priority: HIGH for action security_group_rules [ 1170.990787] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 with Priority: HIGH for action security_group_rules [ 1170.990939] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 with Priority: HIGH for action security_group_rules [ 1170.991069] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50796b58-8a93-4487-8eed-daf2f0262adc with Priority: HIGH for action security_group_rules [ 1170.991132] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a51886-1748-4f34-be32-1ba9c09de405 with Priority: HIGH for action security_group_rules [ 1170.991219] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 with Priority: HIGH for action security_group_rules [ 1170.991304] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c with Priority: HIGH for action security_group_rules [ 1170.991391] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba with Priority: HIGH for action security_group_rules [ 1170.991478] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 with Priority: HIGH for action security_group_rules [ 1170.991565] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beef0235-0372-4fe8-a0e3-e4255271d6ce with Priority: HIGH for action security_group_rules [ 1170.991696] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 with Priority: HIGH for action security_group_rules [ 1170.991793] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGH for action security_group_rules [ 1170.992266] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.992696] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.992825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.993050] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.993137] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52f8f7d9-4c0c-462c-8639-ee701cd7952b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.994086] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.994208] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.994317] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.994427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.994500] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3c6c493-02b2-4cc9-86d0-15e7a48daae4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.995249] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-041bde4c-c513-4b39-85d4-3d543865b6f0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.995353] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.995420] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.995567] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.995637] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('041bde4c-c513-4b39-85d4-3d543865b6f0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.996334] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.996444] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.996507] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.996656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.996729] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63af98c3-e3a7-4ddd-84ed-0fd58e3e4181',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.997409] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2695bb32-670b-49f4-b84e-274269e20fe5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.997610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.997610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.997720] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.997786] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2695bb32-670b-49f4-b84e-274269e20fe5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.998628] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec4d7bd2-dee8-4667-8923-366f583eec53 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.998764] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.998764] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.998915] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.999143] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec4d7bd2-dee8-4667-8923-366f583eec53',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.000422] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a96b9fdf-0e4e-492b-ba29-5c5513d45f05 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.000535] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.000604] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.000769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.000846] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a96b9fdf-0e4e-492b-ba29-5c5513d45f05',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.001553] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed4cc3e0-52bb-498d-9f73-56ded2b5d090 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.001638] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.001694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.001848] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.001921] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed4cc3e0-52bb-498d-9f73-56ded2b5d090',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.002614] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.002769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.002925] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.002962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.003793] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46e7bb0e-3b0b-455c-8638-3cb59c191bf9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.004550] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f885e47a-f0d6-416e-9871-7d36cac6dbc6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.004659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.004723] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.004879] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.004953] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f885e47a-f0d6-416e-9871-7d36cac6dbc6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.005689] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.005795] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.005863] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.006018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.006091] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4aa62458-e6a1-47ca-9f29-72a54d1dc002',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.006878] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50796b58-8a93-4487-8eed-daf2f0262adc taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.007073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.007112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.007263] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.007340] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50796b58-8a93-4487-8eed-daf2f0262adc',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.008156] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1a51886-1748-4f34-be32-1ba9c09de405 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.008245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.008304] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.008453] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.008725] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1a51886-1748-4f34-be32-1ba9c09de405',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.009194] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.009282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.009349] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.009555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.009612] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88bcc035-9dc7-4401-b37d-3fe17bc7b0f6',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.010236] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.010342] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.010408] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.010553] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.010643] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f682c5f3-6947-4cf3-a94e-7b777b1efe4c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.011282] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df5faca2-f036-4823-a1d7-4ca3af9ed4ba taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.011393] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.011460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.011605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.011702] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df5faca2-f036-4823-a1d7-4ca3af9ed4ba',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.013037] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.013037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.013037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.013037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.013037] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85d75a9b-90ae-4f22-b7a1-48280a25caf8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.013620] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-beef0235-0372-4fe8-a0e3-e4255271d6ce taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.013745] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.013790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.013933] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.014010] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('beef0235-0372-4fe8-a0e3-e4255271d6ce',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.014674] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.014943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.014943] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.015111] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.015111] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15b2f848-e9f8-46b8-b9dc-b82509a3b126',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.016556] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.016556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.016556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.016556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.016556] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.017918] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 1171.018121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.042286] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.042446] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.042483] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.042702] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.045159] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.045159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.063571] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.063704] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3c6c493-02b2-4cc9-86d0-15e7a48daae4 is going to be deleted. [ 1171.064599] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.064839] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.082844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.082844] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63af98c3-e3a7-4ddd-84ed-0fd58e3e4181 is going to be deleted. [ 1171.119683] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.119842] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.119928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.120135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.120232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.120356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3c6c493-02b2-4cc9-86d0-15e7a48daae4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.132058] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.132249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.132249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.132447] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.132536] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.132656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63af98c3-e3a7-4ddd-84ed-0fd58e3e4181" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.533829] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f8f7d9-4c0c-462c-8639-ee701cd7952b taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.534050] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.534050] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.534265] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.534427] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.534525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.535059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.535241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.535339] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.535432] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.535524] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52f8f7d9-4c0c-462c-8639-ee701cd7952b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.538343] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.538509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.538509] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.538884] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.538884] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.538981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.538981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.539132] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.539217] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.539302] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.539389] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.561475] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.561694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.561764] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.562070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.563810] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.563920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.602105] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.602217] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.603058] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.603185] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.603886] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.603982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.604676] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.604771] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.605142] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.605232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.605924] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.606031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.607064] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.607162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.607859] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.607953] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.608665] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.608780] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.609421] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1171.609817] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.609917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.610562] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1171.611055] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.611164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.611797] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1171.612188] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.612287] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.612891] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1171.613304] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.613392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.613974] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1171.614365] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.614463] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.615107] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1171.615529] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.615639] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: beef0235-0372-4fe8-a0e3-e4255271d6ce is going to be deleted. [ 1171.616541] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.616762] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.648856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.649034] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 041bde4c-c513-4b39-85d4-3d543865b6f0 is going to be deleted. [ 1171.649929] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.650175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.690263] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.690399] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88bcc035-9dc7-4401-b37d-3fe17bc7b0f6 is going to be deleted. [ 1171.691363] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.691574] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.711912] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.712104] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.715599] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.715764] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46e7bb0e-3b0b-455c-8638-3cb59c191bf9 is going to be deleted. [ 1171.716649] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.716891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.730117] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.730290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.742944] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.743146] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15b2f848-e9f8-46b8-b9dc-b82509a3b126 is going to be deleted. [ 1171.744049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.744278] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.747795] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.747924] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.769255] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.769503] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4aa62458-e6a1-47ca-9f29-72a54d1dc002 is going to be deleted. [ 1171.770993] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.771340] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.802695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.802854] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec4d7bd2-dee8-4667-8923-366f583eec53 is going to be deleted. [ 1171.803880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.804162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.805993] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.806139] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.867017] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.867214] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.876195] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.876195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.877172] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.877306] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1a51886-1748-4f34-be32-1ba9c09de405 is going to be deleted. [ 1171.878339] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.878586] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.938732] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.938884] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df5faca2-f036-4823-a1d7-4ca3af9ed4ba is going to be deleted. [ 1171.939974] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.940245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.941771] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.941917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.015289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.015635] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed4cc3e0-52bb-498d-9f73-56ded2b5d090 is going to be deleted. [ 1172.016427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.016659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.044404] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52f8f7d9-4c0c-462c-8639-ee701cd7952b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.050646] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.073427] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.073556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.090615] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.090815] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f885e47a-f0d6-416e-9871-7d36cac6dbc6 is going to be deleted. [ 1172.091830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.092087] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.145962] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.145962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.153367] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.153513] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50796b58-8a93-4487-8eed-daf2f0262adc is going to be deleted. [ 1172.154553] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.154783] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.156243] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.156348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.241326] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.241521] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a96b9fdf-0e4e-492b-ba29-5c5513d45f05 is going to be deleted. [ 1172.242438] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.242694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.257223] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.257400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.297847] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.298042] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2695bb32-670b-49f4-b84e-274269e20fe5 is going to be deleted. [ 1172.299015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.299285] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.421949] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.422162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.427955] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.428185] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.429010] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.429140] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85d75a9b-90ae-4f22-b7a1-48280a25caf8 is going to be deleted. [ 1172.430084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.430312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.466443] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.466610] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f682c5f3-6947-4cf3-a94e-7b777b1efe4c is going to be deleted. [ 1172.467636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.467878] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.467976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.468149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-041bde4c-c513-4b39-85d4-3d543865b6f0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.468330] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.468499] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.468583] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.468704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-beef0235-0372-4fe8-a0e3-e4255271d6ce" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.469479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.469677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.469756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.469891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88bcc035-9dc7-4401-b37d-3fe17bc7b0f6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.470067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.470229] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.470518] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.470778] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46e7bb0e-3b0b-455c-8638-3cb59c191bf9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.470922] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.471182] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.471315] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.471495] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4aa62458-e6a1-47ca-9f29-72a54d1dc002" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.471707] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.471932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.472074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.472257] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15b2f848-e9f8-46b8-b9dc-b82509a3b126" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.472461] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.472682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.472935] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.473130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec4d7bd2-dee8-4667-8923-366f583eec53" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.473295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.473468] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.473552] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.473671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1a51886-1748-4f34-be32-1ba9c09de405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.473824] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.474009] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.474099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.474219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df5faca2-f036-4823-a1d7-4ca3af9ed4ba" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.474428] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.474581] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.474661] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.474776] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed4cc3e0-52bb-498d-9f73-56ded2b5d090" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.474910] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.475086] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.475168] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.475287] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f885e47a-f0d6-416e-9871-7d36cac6dbc6" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.475426] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.475567] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.475645] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.475753] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50796b58-8a93-4487-8eed-daf2f0262adc" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.475883] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.476036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.476112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.476221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a96b9fdf-0e4e-492b-ba29-5c5513d45f05" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.497332] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.497536] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.497536] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.497761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.497859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.498075] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2695bb32-670b-49f4-b84e-274269e20fe5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.547824] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52f8f7d9-4c0c-462c-8639-ee701cd7952b: rpc.has_security_group_logging(os_id): False [ 1172.553191] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28b8ed16-99b8-40b6-8095-2254b0cf928c: rpc.has_security_group_logging(os_id): False [ 1172.585347] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.585564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.585980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.585980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.586106] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.586247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85d75a9b-90ae-4f22-b7a1-48280a25caf8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.597056] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.597235] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.597299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.597529] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.597648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.597760] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f682c5f3-6947-4cf3-a94e-7b777b1efe4c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.609112] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.609423] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.609539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.609827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.611768] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.611909] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.642275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.642539] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.642640] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.642709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.642975] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.643081] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.643170] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c is going to be updated. [ 1172.644350] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.644535] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.685649] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.686091] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.686288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.686406] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.686680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.686838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.686966] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b is going to be updated. [ 1172.800148] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.800366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.800366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.800584] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.800852] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.817784] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b in Status: IN_PROGRESS for 2s [ 1172.826805] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.827050] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.827050] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.827248] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.827392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.844728] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: IN_PROGRESS for 2s [ 1173.345507] env[70006]: INFO networking_nsxv3.common.synchronization [req-e66508c1-5380-482a-98e6-a2dadb035aed req-c0cfd601-9ae7-4069-b961-42faecd89fed tempest-ServerActionsTestJSON-71305913 tempest-ServerActionsTestJSON-71305913-project-member] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 1173.346055] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 1173.346360] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.346479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.346544] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.346734] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.346878] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.346968] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.347120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.347282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.347366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.347458] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.850521] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.850521] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.850521] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.850521] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.850521] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.850521] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.850923] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.850923] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.850923] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.850923] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.851078] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c is going to be updated. [ 1173.871653] env[70006]: INFO networking_nsxv3.common.synchronization [None req-b36e7755-0e64-485a-8c83-1b49dff2ffb8 tempest-AttachVolumeShelveTestJSON-1969238173 tempest-AttachVolumeShelveTestJSON-1969238173-project-member] Enqueued Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_rules [ 1173.872457] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_rules [ 1173.872542] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a1f4e07-2a71-4bf1-8382-753fd9965928 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.872671] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.872894] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.873050] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.873142] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.879763] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.879890] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.879962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.880328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.880328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.889339] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: IN_PROGRESS for 2s [ 1173.946535] env[70006]: INFO networking_nsxv3.common.synchronization [None req-1e59f8a2-a0f7-4905-8e01-80a22e085bd8 tempest-AttachVolumeShelveTestJSON-1969238173 tempest-AttachVolumeShelveTestJSON-1969238173-project-member] Enqueued Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_rules [ 1173.947143] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_rules [ 1173.947441] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a1f4e07-2a71-4bf1-8382-753fd9965928 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.947543] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.394530] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.394891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.394891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.394971] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.395112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.395214] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 already deleted. [ 1174.395300] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.395478] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.395639] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.395724] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.833728] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b in Status: SUCCESS [ 1174.833728] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.854675] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: SUCCESS [ 1174.854675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.915680] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.915680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.915680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.915680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.915680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.915978] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 already deleted. [ 1174.915978] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.900338] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: SUCCESS [ 1175.900581] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c deletion is rescheduled due to dependency. [ 1175.900626] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.948611] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1178.948843] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1179.388413] env[70006]: INFO networking_nsxv3.common.synchronization [req-990d2cfc-4c29-4eb7-901b-0b6bcd63dfc6 req-c1f6083b-52c3-4f6f-97f7-d628499fa623 tempest-AttachVolumeShelveTestJSON-1969238173 tempest-AttachVolumeShelveTestJSON-1969238173-project-member] Enqueued Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_members [ 1179.389115] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_members [ 1179.389318] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f4e07-2a71-4bf1-8382-753fd9965928 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.389394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.389441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.389738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.390141] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.390141] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.390141] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.390337] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.390337] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.390420] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.894042] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.894435] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.894435] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.894527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.894604] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.894767] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.894869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.894916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.895070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.895152] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.895239] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 already deleted. [ 1179.895307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.896186] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.896361] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.896486] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.896711] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.896962] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.897138] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.897258] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.897494] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.897640] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.897840] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.897958] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.898080] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.898188] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.898298] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.898405] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.898535] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.919485] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.919695] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1179.919797] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.919979] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.920521] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-b9586fe7-a244-4613-a095-504009e343a0 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.920894] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.921107] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.921577] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.921795] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9586fe7-a244-4613-a095-504009e343a0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.157414] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.157792] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.157792] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.158067] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.158365] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.158552] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.158677] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.158963] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.159192] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.159413] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.159531] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1180.159644] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1180.159755] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1180.159867] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.159976] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1180.160133] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1180.177505] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1180.177668] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1180.178801] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1180.178801] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-988" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.178801] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-b209fd87-7748-481e-8262-5ec43c4a436b taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.178801] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.178801] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.179148] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.179148] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b209fd87-7748-481e-8262-5ec43c4a436b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.424057] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.424057] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.424313] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.424473] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.424632] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.424786] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port b9586fe7-a244-4613-a095-504009e343a0 not found, creating... [ 1180.425056] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.425622] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.425776] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.426143] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.426295] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.426587] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.426750] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.426873] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.427121] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.427275] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.427420] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: b9586fe7-a244-4613-a095-504009e343a0 is going to be created. [ 1180.447887] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.448121] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.448257] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.448543] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.448787] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.449035] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.681503] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.681732] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.681868] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.682199] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.682360] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.682676] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.682890] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.683052] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.683286] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.683430] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.683711] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.683871] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.684021] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.684263] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.684400] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.684549] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: b209fd87-7748-481e-8262-5ec43c4a436b is going to be updated. [ 1180.706120] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.706343] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.706469] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.706748] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.706957] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.707208] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.130750] env[70006]: INFO networking_nsxv3.common.synchronization [req-990d2cfc-4c29-4eb7-901b-0b6bcd63dfc6 req-d5fb066f-1d93-4995-b9cf-2883589a9f0d service nova] Enqueued Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_rules [ 1181.130935] env[70006]: INFO networking_nsxv3.common.synchronization [req-990d2cfc-4c29-4eb7-901b-0b6bcd63dfc6 req-d5fb066f-1d93-4995-b9cf-2883589a9f0d service nova] Enqueued Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_members [ 1181.131124] env[70006]: INFO networking_nsxv3.common.synchronization [req-990d2cfc-4c29-4eb7-901b-0b6bcd63dfc6 req-d5fb066f-1d93-4995-b9cf-2883589a9f0d service nova] Enqueued Resource ID: b9586fe7-a244-4613-a095-504009e343a0 with Priority: HIGHEST for action port [ 1181.131371] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_rules [ 1181.131503] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_members [ 1181.131600] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9586fe7-a244-4613-a095-504009e343a0 with Priority: HIGHEST for action port [ 1181.132358] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a1f4e07-2a71-4bf1-8382-753fd9965928 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.132449] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.132520] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.132728] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.132811] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.134194] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f4e07-2a71-4bf1-8382-753fd9965928 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.134317] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.134387] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.134568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.134814] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.134941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.135015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.135182] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.135275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.135368] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.137031] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9586fe7-a244-4613-a095-504009e343a0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.137161] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.137161] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.137309] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.137386] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9586fe7-a244-4613-a095-504009e343a0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.390316] env[70006]: INFO networking_nsxv3.common.synchronization [req-74c1a98c-7049-4f1a-adc5-aba3d0bdd01a req-f8468370-e9bd-4f9c-a383-40a12a89d37d service nova] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_rules [ 1181.390316] env[70006]: INFO networking_nsxv3.common.synchronization [req-74c1a98c-7049-4f1a-adc5-aba3d0bdd01a req-f8468370-e9bd-4f9c-a383-40a12a89d37d service nova] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1181.390316] env[70006]: INFO networking_nsxv3.common.synchronization [req-74c1a98c-7049-4f1a-adc5-aba3d0bdd01a req-f8468370-e9bd-4f9c-a383-40a12a89d37d service nova] Enqueued Resource ID: b209fd87-7748-481e-8262-5ec43c4a436b with Priority: HIGHEST for action port [ 1181.390316] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_rules [ 1181.390807] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1181.391065] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b209fd87-7748-481e-8262-5ec43c4a436b with Priority: HIGHEST for action port [ 1181.391955] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.392254] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.393044] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.393044] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.393044] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.394395] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.394654] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.394910] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.395164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.395373] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.395520] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.395639] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.395837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.396026] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.396178] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.397589] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-b209fd87-7748-481e-8262-5ec43c4a436b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.397713] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.397785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.397947] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.398044] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b209fd87-7748-481e-8262-5ec43c4a436b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.635432] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f4e07-2a71-4bf1-8382-753fd9965928 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.635685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.637036] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.642020] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9586fe7-a244-4613-a095-504009e343a0 with status ACTIVE [ 1181.642020] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.642020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.642020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.642020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.642020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.642020] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.642020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.642020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.642020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.642020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.642020] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.642020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.642020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.642020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.642020] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.642020] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9586fe7-a244-4613-a095-504009e343a0 is going to be updated. [ 1181.662595] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.662595] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.662595] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.662879] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.662879] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.663042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.692305] env[70006]: INFO networking_nsxv3.common.synchronization [req-4fd4fead-b073-457d-9d7d-e6f3ccc19916 req-3223a6ec-0667-4ace-8ab2-58c357659439 tempest-ServerActionsTestJSON-71305913 tempest-ServerActionsTestJSON-71305913-project-member] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 1181.692305] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 1181.692305] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.692535] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.692535] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.692634] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.692738] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.692836] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.693046] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.693144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.693311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.693311] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.895704] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.895852] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.899225] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.900761] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b209fd87-7748-481e-8262-5ec43c4a436b with status ACTIVE [ 1181.900761] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.900761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.900761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.900997] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.900997] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.901152] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.901224] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.901282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.901441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.901521] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.901987] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.901987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.901987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.902216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.902216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.902299] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b209fd87-7748-481e-8262-5ec43c4a436b is going to be updated. [ 1181.924087] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.924379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.924379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.924513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.924648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.924802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b209fd87-7748-481e-8262-5ec43c4a436b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.991539] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-405 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.991728] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.991839] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.992123] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.992378] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.992535] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.992653] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.992948] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.993161] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.993337] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1181.993453] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1181.993562] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1181.993671] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1181.993783] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1181.993980] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1181.994174] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1182.022455] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1182.022615] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1182.022760] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1182.023024] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.023376] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-461fa18b-f3db-4db6-ba87-fe872af49659 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.023723] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-461fa18b-f3db-4db6-ba87-fe872af49659" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.023723] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-461fa18b-f3db-4db6-ba87-fe872af49659" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.024107] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-461fa18b-f3db-4db6-ba87-fe872af49659" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.024294] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('461fa18b-f3db-4db6-ba87-fe872af49659',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.139763] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.196030] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.196030] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.196030] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.196246] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.196246] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.196384] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.196488] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.196552] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.196712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.196787] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.196925] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c is going to be updated. [ 1182.229585] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.229756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.229756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.230539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.230539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.239957] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: IN_PROGRESS for 2s [ 1182.404230] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.526488] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.526723] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.526860] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.527604] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.527786] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.527964] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 461fa18b-f3db-4db6-ba87-fe872af49659 not found, creating... [ 1182.528236] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.528394] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.528516] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.528749] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.528890] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.529183] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.529334] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.530460] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.530460] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.530460] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.530460] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 461fa18b-f3db-4db6-ba87-fe872af49659 is going to be created. [ 1182.554438] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.554647] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.554801] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.555088] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.555352] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.555597] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-461fa18b-f3db-4db6-ba87-fe872af49659" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.642530] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.642684] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.642748] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.643142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.643258] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.643371] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 is going to be created. [ 1182.682987] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.683245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.683358] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.683688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.683995] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.693770] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 in Status: UNINITIALIZED for 2s [ 1182.907295] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.907496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.907562] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.907807] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.907903] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.908031] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be updated. [ 1182.939635] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.939844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.939844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.940064] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.940224] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.949346] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 1183.255600] env[70006]: INFO networking_nsxv3.common.synchronization [req-4fd4fead-b073-457d-9d7d-e6f3ccc19916 req-cef9e774-6b80-41cb-b2ca-d28f73676a75 service nova] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_rules [ 1183.255887] env[70006]: INFO networking_nsxv3.common.synchronization [req-4fd4fead-b073-457d-9d7d-e6f3ccc19916 req-cef9e774-6b80-41cb-b2ca-d28f73676a75 service nova] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 1183.256126] env[70006]: INFO networking_nsxv3.common.synchronization [req-4fd4fead-b073-457d-9d7d-e6f3ccc19916 req-cef9e774-6b80-41cb-b2ca-d28f73676a75 service nova] Enqueued Resource ID: 461fa18b-f3db-4db6-ba87-fe872af49659 with Priority: HIGHEST for action port [ 1183.256899] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_rules [ 1183.257152] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 1183.257349] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461fa18b-f3db-4db6-ba87-fe872af49659 with Priority: HIGHEST for action port [ 1183.257742] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.257907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.258050] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.258369] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.258503] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.259728] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.259892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.260784] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-461fa18b-f3db-4db6-ba87-fe872af49659 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.260976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-461fa18b-f3db-4db6-ba87-fe872af49659" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.261110] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-461fa18b-f3db-4db6-ba87-fe872af49659" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.261369] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-461fa18b-f3db-4db6-ba87-fe872af49659" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.261457] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('461fa18b-f3db-4db6-ba87-fe872af49659',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.763984] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.764320] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.764442] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 461fa18b-f3db-4db6-ba87-fe872af49659 with status ACTIVE [ 1183.764627] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.764732] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.764808] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.765127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.765223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.765483] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.765483] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.765632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.765706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.765785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.765967] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.766085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.766148] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.766299] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.766400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.766500] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 461fa18b-f3db-4db6-ba87-fe872af49659 is going to be updated. [ 1183.790636] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.790817] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.790891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.791154] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.791298] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.791523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-461fa18b-f3db-4db6-ba87-fe872af49659" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.249715] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: SUCCESS [ 1184.249912] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c deletion is rescheduled due to dependency. [ 1184.249912] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.250127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.250357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.250553] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.250667] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.250734] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.250980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.251074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.251170] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.704606] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 in Status: SUCCESS [ 1184.704825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.705029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.705295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.705498] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.705625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.705692] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.706025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.706130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.706130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.706228] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.753755] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.961057] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 1184.961437] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.961552] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.961797] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.962043] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.962185] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.962247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.962487] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.962487] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.962601] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.962719] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.208457] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.255522] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.464953] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.465161] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.465286] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.465465] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.465633] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.465732] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.465798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.465945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.466045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.466133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.466285] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.466374] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.466433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.466642] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.466710] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.466793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.466853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.466989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.467079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.467159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.467246] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.711471] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a1f4e07-2a71-4bf1-8382-753fd9965928: rpc.has_security_group_logging(os_id): False [ 1185.730977] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.731062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.731097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.731337] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.731454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.731726] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.731862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.731898] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.732071] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.732269] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.732320] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 is going to be created. [ 1185.758268] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.758492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.758492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.758785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.758846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.758919] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c is going to be updated. [ 1185.794886] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.795074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.795118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.795326] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.795473] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.807216] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: IN_PROGRESS for 2s [ 1185.826069] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.826336] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.826436] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.826668] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.826849] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.842068] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 in Status: IN_PROGRESS for 2s [ 1185.970090] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcb3911f-9d2b-45be-a214-581dc745aaa9: rpc.has_security_group_logging(os_id): False [ 1185.990829] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.991159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.991159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.991288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.991347] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.991582] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.991746] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.991746] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.991888] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.991963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.992169] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.992276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.992334] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.992455] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.992529] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.992702] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.992816] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.992863] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.993252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.993468] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.993589] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be updated. [ 1186.065672] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.066402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.066402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.066402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.066546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.082122] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 1187.821073] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: SUCCESS [ 1187.821479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.821479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.821610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.821806] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.821921] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.821989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.822174] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.822281] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.822379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.822480] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.853716] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 in Status: SUCCESS [ 1187.853964] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.096961] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 1188.097240] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.258415] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1188.258415] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1188.324961] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.406431] env[70006]: INFO networking_nsxv3.common.synchronization [req-f09a4564-1b2a-42a3-be30-822db010f127 req-07449688-3596-466f-9469-83c1df8b573b tempest-DeleteServersTestJSON-472565240 tempest-DeleteServersTestJSON-472565240-project-member] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1188.406570] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGHEST for action security_group_members [ 1188.406869] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.407172] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.407251] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.407446] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.407597] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.407693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.407751] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.407887] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.407985] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.408102] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.828861] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28b8ed16-99b8-40b6-8095-2254b0cf928c: rpc.has_security_group_logging(os_id): False [ 1188.849924] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.849924] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.849924] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.849924] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.849924] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.849924] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.849924] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.849924] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.849924] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.849924] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.849924] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c is going to be updated. [ 1188.913621] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.913621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.913621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.913621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.938931] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.939380] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.940274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.940418] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.940751] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.941212] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.941387] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be updated. [ 1188.956911] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.957130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.957260] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.957555] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.957744] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.975194] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: IN_PROGRESS for 2s [ 1188.976145] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.976274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.976340] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.976545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.976677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.985564] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: IN_PROGRESS for 2s [ 1189.129566] env[70006]: INFO networking_nsxv3.common.synchronization [req-b5460b06-ca45-4802-8160-2a8298f53c95 req-1b6dfef2-7a3f-4339-abcc-e89b95b0c7ec tempest-ServersTestJSON-294753548 tempest-ServersTestJSON-294753548-project-member] Enqueued Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGHEST for action security_group_members [ 1189.130168] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGHEST for action security_group_members [ 1189.130514] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f8f7d9-4c0c-462c-8639-ee701cd7952b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.130663] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.130738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.131009] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.131194] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.131318] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.131388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.131570] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.131674] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.131784] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52f8f7d9-4c0c-462c-8639-ee701cd7952b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.633830] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.634066] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.634112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.634340] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.634455] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.634638] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.634747] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.634793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.634949] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.635067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.635149] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b is going to be updated. [ 1189.661892] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.662089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.662130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.662336] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.662470] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.673751] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b in Status: IN_PROGRESS for 2s [ 1190.989085] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: SUCCESS [ 1190.989085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.996024] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 in Status: SUCCESS [ 1190.996024] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 deletion is rescheduled due to dependency. [ 1190.996024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.688106] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b in Status: SUCCESS [ 1191.688314] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b deletion is rescheduled due to dependency. [ 1191.688438] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.130815] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1194.131438] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1196.361856] env[70006]: INFO networking_nsxv3.common.synchronization [None req-fc3322a8-6105-448d-a850-8a741b1963ce None None] Enqueued Resource ID: fe06571f-5f5e-4c76-8434-9b98f018f299 with Priority: HIGHEST for action port [ 1196.362134] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe06571f-5f5e-4c76-8434-9b98f018f299 with Priority: HIGHEST for action port [ 1196.362699] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe06571f-5f5e-4c76-8434-9b98f018f299 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.362876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe06571f-5f5e-4c76-8434-9b98f018f299" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.362959] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe06571f-5f5e-4c76-8434-9b98f018f299" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.367319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe06571f-5f5e-4c76-8434-9b98f018f299" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.367418] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe06571f-5f5e-4c76-8434-9b98f018f299',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.869468] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe06571f-5f5e-4c76-8434-9b98f018f299 [ 1196.869661] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.869793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.869876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.870139] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.870281] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.870430] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe06571f-5f5e-4c76-8434-9b98f018f299 already deleted. [ 1196.870568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe06571f-5f5e-4c76-8434-9b98f018f299" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.511626] env[70006]: INFO networking_nsxv3.common.synchronization [req-86b0ae9b-e43c-4dc0-aa35-483346a852f3 req-ba6875cc-10a5-4a72-bfb4-bc54911bea9f tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_members [ 1197.512176] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_members [ 1197.512485] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1869c6-76a1-476b-ae81-d81b81b97f5a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.512607] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.512675] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.512875] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.513071] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.513162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.513226] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.513380] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.513459] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.513557] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.016360] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.413258] env[70006]: INFO networking_nsxv3.common.synchronization [None req-0fd0fc88-42f9-43f9-841a-5bc435477383 None None] Enqueued Resource ID: b7ab3e06-830c-4f24-9149-45c383b02431 with Priority: HIGHEST for action port [ 1198.413573] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7ab3e06-830c-4f24-9149-45c383b02431 with Priority: HIGHEST for action port [ 1198.414090] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7ab3e06-830c-4f24-9149-45c383b02431 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.414216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7ab3e06-830c-4f24-9149-45c383b02431" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.414284] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7ab3e06-830c-4f24-9149-45c383b02431" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.414538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7ab3e06-830c-4f24-9149-45c383b02431" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.414622] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7ab3e06-830c-4f24-9149-45c383b02431',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.519773] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.917434] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7ab3e06-830c-4f24-9149-45c383b02431 [ 1198.917671] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.917810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.917882] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.918127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.918225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.918323] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7ab3e06-830c-4f24-9149-45c383b02431 already deleted. [ 1198.918405] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7ab3e06-830c-4f24-9149-45c383b02431" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.021577] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.021788] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.021870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.022115] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.022213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.022319] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a is going to be updated. [ 1199.054516] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.054736] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.054736] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.054945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.055124] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.065111] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a in Status: IN_PROGRESS for 2s [ 1201.076715] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a in Status: SUCCESS [ 1201.077108] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.767719] env[70006]: INFO networking_nsxv3.common.synchronization [req-90721d99-ccae-4766-8843-a7a94cd9c40e req-a8db57bd-1df8-4bea-8003-70fbaff8bea1 tempest-InstanceActionsNegativeTestJSON-99035032 tempest-InstanceActionsNegativeTestJSON-99035032-project-member] Enqueued Resource ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c with Priority: HIGHEST for action security_group_members [ 1201.768258] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c with Priority: HIGHEST for action security_group_members [ 1201.768564] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9bd1969-8f85-4f80-a738-0f3c9578a25c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.768683] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.768750] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.769014] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.770274] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.770401] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.770467] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.770653] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.770743] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.770836] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9bd1969-8f85-4f80-a738-0f3c9578a25c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.033019] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.033343] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-588" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.033532] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-588" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.033978] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-588" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.034383] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.034613] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.034787] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.035109] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.035322] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.035613] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1202.035785] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1202.035954] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1202.036136] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1202.036312] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1202.036477] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1202.036672] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1202.056461] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1202.056728] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1202.056893] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1202.057160] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-588" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.057603] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-a6ca2770-f8f4-4f87-9224-4a013733c952 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.057870] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-a6ca2770-f8f4-4f87-9224-4a013733c952" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.058063] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-a6ca2770-f8f4-4f87-9224-4a013733c952" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.058489] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-a6ca2770-f8f4-4f87-9224-4a013733c952" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.058693] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6ca2770-f8f4-4f87-9224-4a013733c952',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.273077] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.273487] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.273487] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.273585] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.273680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.273877] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.273972] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.274049] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.274313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.274389] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.274478] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c already deleted. [ 1202.274557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.561613] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.561835] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.561987] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.562318] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.562485] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.562647] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port a6ca2770-f8f4-4f87-9224-4a013733c952 not found, creating... [ 1202.562908] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.563087] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.563274] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.563559] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.563713] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.563995] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.564204] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.564341] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.564556] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.564712] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.564851] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: a6ca2770-f8f4-4f87-9224-4a013733c952 is going to be created. [ 1202.587164] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.587432] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.587494] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.587773] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.588014] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.588284] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-a6ca2770-f8f4-4f87-9224-4a013733c952" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.297111] env[70006]: INFO networking_nsxv3.common.synchronization [req-90721d99-ccae-4766-8843-a7a94cd9c40e req-72f58ab9-bf32-47ca-8fcc-f92d0fd9f434 service nova] Enqueued Resource ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c with Priority: HIGHEST for action security_group_rules [ 1203.297465] env[70006]: INFO networking_nsxv3.common.synchronization [req-90721d99-ccae-4766-8843-a7a94cd9c40e req-72f58ab9-bf32-47ca-8fcc-f92d0fd9f434 service nova] Enqueued Resource ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c with Priority: HIGHEST for action security_group_members [ 1203.297465] env[70006]: INFO networking_nsxv3.common.synchronization [req-90721d99-ccae-4766-8843-a7a94cd9c40e req-72f58ab9-bf32-47ca-8fcc-f92d0fd9f434 service nova] Enqueued Resource ID: a6ca2770-f8f4-4f87-9224-4a013733c952 with Priority: HIGHEST for action port [ 1203.297934] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c with Priority: HIGHEST for action security_group_rules [ 1203.298116] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c with Priority: HIGHEST for action security_group_members [ 1203.298184] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ca2770-f8f4-4f87-9224-4a013733c952 with Priority: HIGHEST for action port [ 1203.298528] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9bd1969-8f85-4f80-a738-0f3c9578a25c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.298682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.298682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.298897] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.298978] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9bd1969-8f85-4f80-a738-0f3c9578a25c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.300823] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9bd1969-8f85-4f80-a738-0f3c9578a25c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.300979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.301085] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.301306] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.301510] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.301634] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.301725] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.301902] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.302023] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.302157] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9bd1969-8f85-4f80-a738-0f3c9578a25c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.303394] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6ca2770-f8f4-4f87-9224-4a013733c952 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.303496] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6ca2770-f8f4-4f87-9224-4a013733c952" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.303716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6ca2770-f8f4-4f87-9224-4a013733c952" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.303716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6ca2770-f8f4-4f87-9224-4a013733c952" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.303781] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6ca2770-f8f4-4f87-9224-4a013733c952',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.805727] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9bd1969-8f85-4f80-a738-0f3c9578a25c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.807049] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9bd1969-8f85-4f80-a738-0f3c9578a25c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.807313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.807660] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6ca2770-f8f4-4f87-9224-4a013733c952 with status ACTIVE [ 1203.807878] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.807976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.808116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.808383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.808562] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.808816] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.809418] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.809418] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.809418] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.809418] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.809801] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.809883] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.810033] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.810228] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.810361] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.810507] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6ca2770-f8f4-4f87-9224-4a013733c952 is going to be updated. [ 1203.833591] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.833784] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.833784] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.833992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.834166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.834377] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6ca2770-f8f4-4f87-9224-4a013733c952" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.313056] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9bd1969-8f85-4f80-a738-0f3c9578a25c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.815036] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.815261] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.815312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.815545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.815642] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.815813] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c is going to be created. [ 1204.839455] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.839660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.839660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.839892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.840089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.854258] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c in Status: UNINITIALIZED for 2s [ 1206.865393] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c in Status: SUCCESS [ 1206.865669] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.865877] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.866111] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.866303] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.866421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.866485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.866644] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.866722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.866803] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.866889] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9bd1969-8f85-4f80-a738-0f3c9578a25c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.182182] env[70006]: INFO networking_nsxv3.common.synchronization [req-02d19845-53fd-4098-ace6-ac37e48ef384 req-1755eb90-8121-4757-a480-5f27113a7469 tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_members [ 1207.182792] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGHEST for action security_group_members [ 1207.183233] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1869c6-76a1-476b-ae81-d81b81b97f5a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.183426] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.183931] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.183931] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.183931] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.184292] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.184292] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.184379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.184474] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.184607] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.369599] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9bd1969-8f85-4f80-a738-0f3c9578a25c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.369870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.370073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.370527] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.371105] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.371105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.371105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.371311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.371437] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.371552] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.372071] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9bd1969-8f85-4f80-a738-0f3c9578a25c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.372071] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.372071] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.372242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.372502] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.372661] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.372799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.372965] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.373079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.373237] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.373449] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9bd1969-8f85-4f80-a738-0f3c9578a25c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.688696] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.688857] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.688900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.689202] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.710920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.711260] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.711365] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.711430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.711632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.711715] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.711822] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a is going to be updated. [ 1207.737134] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.737326] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.737326] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.737537] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.738303] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.745478] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a in Status: IN_PROGRESS for 2s [ 1207.876226] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9bd1969-8f85-4f80-a738-0f3c9578a25c: rpc.has_security_group_logging(os_id): False [ 1207.895390] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.895621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.895621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.895800] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.895890] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.896089] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.896205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.896273] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.896424] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.896498] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.896682] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.896774] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.896836] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.896976] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.897060] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.897255] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.897348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.897408] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.897548] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.897618] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.897702] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c is going to be created. [ 1207.955869] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.956104] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.956104] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.956335] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.956515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.966798] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c in Status: IN_PROGRESS for 2s [ 1209.755472] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a in Status: SUCCESS [ 1209.755472] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a deletion is rescheduled due to dependency. [ 1209.755472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.978252] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c in Status: SUCCESS [ 1209.978492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.654435] env[70006]: INFO networking_nsxv3.common.synchronization [None req-0cc46589-a164-4a5d-8224-0b1f75d520cf tempest-AttachInterfacesTestJSON-1305632387 tempest-AttachInterfacesTestJSON-1305632387-project-member] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1211.654900] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGHEST for action security_group_members [ 1211.655197] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.656031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.656031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.656031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.656031] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.656031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.656031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.656031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.656305] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.656305] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.160954] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.161097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.161196] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.161637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.161637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.161734] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.161815] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.161880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.162273] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.162273] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.162273] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be updated. [ 1212.192168] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.192346] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.192402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.192661] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.192846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.202125] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: IN_PROGRESS for 2s [ 1212.681070] env[70006]: INFO networking_nsxv3.common.synchronization [req-46294b17-dd64-4e4d-ac93-34102c0f9a4a req-dd29ecf9-706c-48ea-875e-7c7969e691a7 tempest-InstanceActionsNegativeTestJSON-99035032 tempest-InstanceActionsNegativeTestJSON-99035032-project-member] Enqueued Resource ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c with Priority: HIGHEST for action security_group_members [ 1212.681642] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c with Priority: HIGHEST for action security_group_members [ 1212.682045] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9bd1969-8f85-4f80-a738-0f3c9578a25c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.682179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.682283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.682421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.682576] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.682678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.682873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.682873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.682984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.683056] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9bd1969-8f85-4f80-a738-0f3c9578a25c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.185867] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.185989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.186090] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.186318] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.186408] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.186608] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.187166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.187166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.187166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.187166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.187166] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c is going to be updated. [ 1213.235866] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.236063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.236063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.236276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.236424] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.246901] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c in Status: IN_PROGRESS for 2s [ 1214.212044] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 in Status: SUCCESS [ 1214.212368] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 deletion is rescheduled due to dependency. [ 1214.212368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.257721] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c in Status: SUCCESS [ 1215.258103] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c deletion is rescheduled due to dependency. [ 1215.258103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.683013] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1217.683357] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1222.684648] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1222.685075] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1227.685992] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1227.686410] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1232.687058] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1232.687413] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1237.688477] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1237.688913] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1242.689728] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1242.689728] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1247.691613] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1247.691613] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1252.693274] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1252.693627] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1256.795026] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.795357] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.795357] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.795635] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.795902] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.796076] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.796200] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.796417] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.796565] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.796769] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1256.796884] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1256.796992] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1256.797113] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1256.797224] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1256.797331] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1256.797463] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1256.818391] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1256.818576] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1256.818718] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1256.818902] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-714" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.819254] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-b9586fe7-a244-4613-a095-504009e343a0 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.819437] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.819563] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.819842] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.819992] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9586fe7-a244-4613-a095-504009e343a0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.323293] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.323496] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.323683] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.324099] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.324338] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.324686] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.324868] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.324982] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.325266] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.325476] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.325783] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.325978] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.326105] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.326333] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.326478] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.326624] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: b9586fe7-a244-4613-a095-504009e343a0 is going to be updated. [ 1257.349263] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.349575] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.349777] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.350183] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.350487] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.350831] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.694310] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.694541] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1258.016460] env[70006]: INFO networking_nsxv3.common.synchronization [req-7407a45e-58eb-4bfe-9d73-a223d75d83aa req-ed437fad-e926-42c7-baff-7c1d66de27be service nova] Enqueued Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_rules [ 1258.016758] env[70006]: INFO networking_nsxv3.common.synchronization [req-7407a45e-58eb-4bfe-9d73-a223d75d83aa req-ed437fad-e926-42c7-baff-7c1d66de27be service nova] Enqueued Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_members [ 1258.016800] env[70006]: INFO networking_nsxv3.common.synchronization [req-7407a45e-58eb-4bfe-9d73-a223d75d83aa req-ed437fad-e926-42c7-baff-7c1d66de27be service nova] Enqueued Resource ID: b9586fe7-a244-4613-a095-504009e343a0 with Priority: HIGHEST for action port [ 1258.017030] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_rules [ 1258.017171] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_members [ 1258.017272] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9586fe7-a244-4613-a095-504009e343a0 with Priority: HIGHEST for action port [ 1258.017860] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a1f4e07-2a71-4bf1-8382-753fd9965928 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.017991] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.018217] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.018477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.018581] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.021979] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f4e07-2a71-4bf1-8382-753fd9965928 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.021979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.021979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.021979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.021979] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.021979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.021979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.021979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.021979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.021979] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.021979] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9586fe7-a244-4613-a095-504009e343a0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.021979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.021979] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.022570] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.022570] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9586fe7-a244-4613-a095-504009e343a0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.523937] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f4e07-2a71-4bf1-8382-753fd9965928 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.524192] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.524280] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.526760] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9586fe7-a244-4613-a095-504009e343a0 with status ACTIVE [ 1258.526944] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.527113] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.527175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.527345] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.527433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.527604] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.527699] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.527761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.527914] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.528009] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.528178] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.528269] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.528321] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.528670] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.528670] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.528670] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9586fe7-a244-4613-a095-504009e343a0 is going to be updated. [ 1258.548157] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.548157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.548157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.548414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.548539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.548647] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9586fe7-a244-4613-a095-504009e343a0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.026792] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.529179] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.529390] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.529484] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.529769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.529932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.530091] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 is going to be updated. [ 1259.560953] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.561175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.561175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.561445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.561585] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.570666] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 in Status: IN_PROGRESS for 2s [ 1261.592718] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 in Status: SUCCESS [ 1261.593239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.593239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.593444] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.593689] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.593884] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.594040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.594166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.594270] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.594514] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.594514] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.098334] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.601019] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a1f4e07-2a71-4bf1-8382-753fd9965928: rpc.has_security_group_logging(os_id): False [ 1262.625752] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.626115] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.626115] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.626276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.626315] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.626641] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.626811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.626918] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.627146] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.627238] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.627327] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 is going to be updated. [ 1262.707251] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.707495] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.707495] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.707725] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.707929] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.729087] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 in Status: IN_PROGRESS for 2s [ 1263.018090] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1263.018283] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1263.996698] env[70006]: INFO networking_nsxv3.common.synchronization [req-f2061545-9cf6-4ecb-b80d-a19232fac1db req-4ded63f1-f540-40ba-a0c0-e96269e35810 tempest-ServerActionsTestJSON-71305913 tempest-ServerActionsTestJSON-71305913-project-member] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 1263.997131] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 1263.997442] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.997564] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.997630] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.997842] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.997994] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.998106] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.998166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.998317] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.998394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.998489] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.501311] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.501604] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.501747] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.502136] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.502324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.502706] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.502892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.502996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.503985] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.503985] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.503985] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c is going to be updated. [ 1264.553207] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.553533] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.553533] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.553703] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.553909] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.572850] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: IN_PROGRESS for 2s [ 1264.745211] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 in Status: SUCCESS [ 1264.745420] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.586081] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: SUCCESS [ 1266.586471] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c deletion is rescheduled due to dependency. [ 1266.586471] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.998773] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1268.999184] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1271.065494] env[70006]: INFO networking_nsxv3.common.synchronization [req-ad437b39-5b14-46ef-ba72-b61f95d9deb2 req-aa7cb5b4-c404-478b-a8e5-66c72585cc5c tempest-ServerActionsTestJSON-71305913 tempest-ServerActionsTestJSON-71305913-project-member] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 1271.065876] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 1271.066208] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.066332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.066398] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.066591] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.066740] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.066838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.066932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.067135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.067241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.067339] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.338611] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-405 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.338845] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.338976] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.339389] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.339682] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.339857] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.339988] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.340244] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.340399] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.340617] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1271.341095] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1271.341095] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1271.341095] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1271.341095] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1271.341263] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1271.341334] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1271.363949] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1271.364195] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1271.364349] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1271.364545] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-405" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.364938] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-bb5d8627-a5f4-4491-a43e-35304de48645 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.365170] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-bb5d8627-a5f4-4491-a43e-35304de48645" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.365299] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-bb5d8627-a5f4-4491-a43e-35304de48645" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.365684] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-bb5d8627-a5f4-4491-a43e-35304de48645" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.365839] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb5d8627-a5f4-4491-a43e-35304de48645',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.570150] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.570150] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.570385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.570557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.570557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.570765] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.570893] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.570940] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.571099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.571205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.571262] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c is going to be updated. [ 1271.599243] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.599417] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.599464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.599672] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.599826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.611189] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: IN_PROGRESS for 2s [ 1271.869142] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.869142] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.869412] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.869526] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.869679] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.869836] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port bb5d8627-a5f4-4491-a43e-35304de48645 not found, creating... [ 1271.870119] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.870280] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.870398] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.870625] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.870763] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.871058] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.871219] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.871339] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.871546] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.871679] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.871823] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: bb5d8627-a5f4-4491-a43e-35304de48645 is going to be created. [ 1271.894631] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.894851] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.894959] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.895273] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.895517] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.895763] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-bb5d8627-a5f4-4491-a43e-35304de48645" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.579752] env[70006]: INFO networking_nsxv3.common.synchronization [req-ad437b39-5b14-46ef-ba72-b61f95d9deb2 req-844a8310-651a-4f40-bf9c-b556a14a1de5 service nova] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_rules [ 1272.580049] env[70006]: INFO networking_nsxv3.common.synchronization [req-ad437b39-5b14-46ef-ba72-b61f95d9deb2 req-844a8310-651a-4f40-bf9c-b556a14a1de5 service nova] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 1272.580097] env[70006]: INFO networking_nsxv3.common.synchronization [req-ad437b39-5b14-46ef-ba72-b61f95d9deb2 req-844a8310-651a-4f40-bf9c-b556a14a1de5 service nova] Enqueued Resource ID: bb5d8627-a5f4-4491-a43e-35304de48645 with Priority: HIGHEST for action port [ 1272.580327] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_rules [ 1272.580473] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 1272.580574] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb5d8627-a5f4-4491-a43e-35304de48645 with Priority: HIGHEST for action port [ 1272.581385] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.581532] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.581623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.581849] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.581975] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.583686] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.583686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.583686] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb5d8627-a5f4-4491-a43e-35304de48645 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.583686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb5d8627-a5f4-4491-a43e-35304de48645" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.584108] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb5d8627-a5f4-4491-a43e-35304de48645" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.584108] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb5d8627-a5f4-4491-a43e-35304de48645" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.584108] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb5d8627-a5f4-4491-a43e-35304de48645',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.086133] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.086133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.086395] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb5d8627-a5f4-4491-a43e-35304de48645 with status ACTIVE [ 1273.086431] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.086639] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.086639] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.086890] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.086952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.087090] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.087184] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.087249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.087414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.087480] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.087659] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.087760] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.087804] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.087950] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.088030] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.088115] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb5d8627-a5f4-4491-a43e-35304de48645 is going to be updated. [ 1273.113447] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.113686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.113686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.113964] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.114151] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.114325] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb5d8627-a5f4-4491-a43e-35304de48645" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.622793] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: SUCCESS [ 1273.623098] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c deletion is rescheduled due to dependency. [ 1273.623280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.623535] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.623855] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.624155] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.624337] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.624441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.624691] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.624825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.624987] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.127831] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.630231] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.132935] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.133111] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.133180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.133376] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.133467] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.133564] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c is going to be updated. [ 1275.162360] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.162573] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.162573] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.162760] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.162903] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.171893] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: IN_PROGRESS for 2s [ 1277.184153] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: SUCCESS [ 1277.184153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.184153] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.184578] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.184578] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.184578] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.184688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.184844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.184844] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.184941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.185032] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.582201] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1277.582373] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1277.688078] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.190936] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28b8ed16-99b8-40b6-8095-2254b0cf928c: rpc.has_security_group_logging(os_id): False [ 1278.209941] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.210177] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.210177] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.210368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.210461] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.210714] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.210814] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.210879] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.211047] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.211126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.211213] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c is going to be updated. [ 1278.285560] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.285788] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.285788] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.285980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.286150] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.299210] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: IN_PROGRESS for 2s [ 1280.315009] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: SUCCESS [ 1280.315450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.583911] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1282.583911] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1287.584853] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1287.585260] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1292.586373] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1292.586717] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1297.587596] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1297.587596] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1302.588831] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1302.589244] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1307.590654] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1307.591183] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1308.966500] env[70006]: INFO networking_nsxv3.common.synchronization [req-ad77090d-55f4-4c67-9d6a-9fdcd9785f4c req-f53e1e17-0bdb-47a8-b895-f2bb906ac6ce tempest-AttachVolumeShelveTestJSON-1969238173 tempest-AttachVolumeShelveTestJSON-1969238173-project-member] Enqueued Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_members [ 1308.966755] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGHEST for action security_group_members [ 1308.966901] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a1f4e07-2a71-4bf1-8382-753fd9965928 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.967043] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.967118] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.967312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.967465] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.969040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.969040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.969040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.969040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.969040] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.471297] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.471297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.471297] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.471617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.471617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.471772] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.471869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.471932] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.472098] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.472175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.472274] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 is going to be updated. [ 1309.503150] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.503360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.503360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.503588] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.503740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.512194] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 in Status: IN_PROGRESS for 2s [ 1311.522597] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 in Status: SUCCESS [ 1311.522984] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 deletion is rescheduled due to dependency. [ 1311.522984] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.968330] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1313.968754] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1318.969897] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1318.970368] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1320.182654] env[70006]: INFO networking_nsxv3.common.synchronization [None req-1eb6036e-dc58-4006-ad89-61d332458cde None None] Enqueued Resource ID: 180c19ec-5a95-4986-89ae-7fcfd946a031 with Priority: HIGHEST for action port [ 1320.182832] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 180c19ec-5a95-4986-89ae-7fcfd946a031 with Priority: HIGHEST for action port [ 1320.183303] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-180c19ec-5a95-4986-89ae-7fcfd946a031 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.183440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-180c19ec-5a95-4986-89ae-7fcfd946a031" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.183529] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-180c19ec-5a95-4986-89ae-7fcfd946a031" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.183792] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-180c19ec-5a95-4986-89ae-7fcfd946a031" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.183879] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('180c19ec-5a95-4986-89ae-7fcfd946a031',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.686166] env[70006]: INFO networking_nsxv3.common.synchronization [None req-26d4e7b6-60f5-442c-847a-4b76f59c2ced tempest-AttachVolumeTestJSON-389518749 tempest-AttachVolumeTestJSON-389518749-project-member] Enqueued Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGHEST for action security_group_rules [ 1320.686455] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 180c19ec-5a95-4986-89ae-7fcfd946a031 [ 1320.686653] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.686802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.686917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.690247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.690247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.690247] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:180c19ec-5a95-4986-89ae-7fcfd946a031 already deleted. [ 1320.690400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-180c19ec-5a95-4986-89ae-7fcfd946a031" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.690783] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGHEST for action security_group_rules [ 1320.691096] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0646470-1725-4121-8506-f62005f5ece8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.691211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.691278] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.691502] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.691585] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0646470-1725-4121-8506-f62005f5ece8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.790401] env[70006]: INFO networking_nsxv3.common.synchronization [None req-47ed66a1-b90e-47ca-9459-e225a6d2bd45 tempest-AttachVolumeTestJSON-389518749 tempest-AttachVolumeTestJSON-389518749-project-member] Enqueued Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGHEST for action security_group_rules [ 1320.790985] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGHEST for action security_group_rules [ 1320.791626] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0646470-1725-4121-8506-f62005f5ece8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.791626] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.216512] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.216905] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.216905] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.217012] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.217047] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.217142] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0646470-1725-4121-8506-f62005f5ece8 already deleted. [ 1321.217225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.217380] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.217545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.217634] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0646470-1725-4121-8506-f62005f5ece8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.738900] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.739102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.739169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.739345] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.739434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.739548] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0646470-1725-4121-8506-f62005f5ece8 already deleted. [ 1321.739636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.257828] env[70006]: INFO networking_nsxv3.common.synchronization [None req-f3cb1393-1810-4d97-8438-0bfc0d9bb4b3 None None] Enqueued Resource ID: 424eca1c-1756-46a4-90e3-2ae7a6a27d98 with Priority: HIGHEST for action port [ 1322.258395] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 424eca1c-1756-46a4-90e3-2ae7a6a27d98 with Priority: HIGHEST for action port [ 1322.259526] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-424eca1c-1756-46a4-90e3-2ae7a6a27d98 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.259526] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-424eca1c-1756-46a4-90e3-2ae7a6a27d98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.259526] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-424eca1c-1756-46a4-90e3-2ae7a6a27d98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.259526] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-424eca1c-1756-46a4-90e3-2ae7a6a27d98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.259526] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('424eca1c-1756-46a4-90e3-2ae7a6a27d98',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.761885] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 424eca1c-1756-46a4-90e3-2ae7a6a27d98 [ 1322.762075] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.762214] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.762284] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.762508] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.762598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.762692] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:424eca1c-1756-46a4-90e3-2ae7a6a27d98 already deleted. [ 1322.762777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-424eca1c-1756-46a4-90e3-2ae7a6a27d98" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.624752] env[70006]: INFO networking_nsxv3.common.synchronization [req-b251bd18-d200-4244-8a49-3a6097414365 req-a68b9497-449c-45d7-8c57-4f435e97063e tempest-AttachVolumeTestJSON-389518749 tempest-AttachVolumeTestJSON-389518749-project-member] Enqueued Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGHEST for action security_group_members [ 1326.624752] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGHEST for action security_group_members [ 1326.624986] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0646470-1725-4121-8506-f62005f5ece8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.625056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.625089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.625581] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.625581] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.625581] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.625741] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.625773] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.625851] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.625970] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0646470-1725-4121-8506-f62005f5ece8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.900073] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-818 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.900347] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-818" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.900516] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-818" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.900921] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-818" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.902828] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.903022] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.903197] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.903468] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.903623] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.903932] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1326.904062] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1326.904289] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1326.904289] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1326.904393] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1326.904487] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1326.904693] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1326.954362] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1326.954588] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.050 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1326.954875] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1326.955128] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-818" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.955472] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-0641d8ef-98b5-48f3-a1a8-6bdafa0154d4 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.955786] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-0641d8ef-98b5-48f3-a1a8-6bdafa0154d4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.955927] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-0641d8ef-98b5-48f3-a1a8-6bdafa0154d4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.956298] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-0641d8ef-98b5-48f3-a1a8-6bdafa0154d4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.956446] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0641d8ef-98b5-48f3-a1a8-6bdafa0154d4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.128441] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.128652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.128698] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.128901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.129051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.129327] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.129437] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.129501] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.129678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.129759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.129843] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0646470-1725-4121-8506-f62005f5ece8 already deleted. [ 1327.129925] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.459796] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.459796] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.459796] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.460119] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.460263] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.460428] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 0641d8ef-98b5-48f3-a1a8-6bdafa0154d4 not found, creating... [ 1327.460693] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.460854] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.460978] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.461233] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.461372] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.461655] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.461813] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.461931] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.462169] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.462305] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.462459] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 0641d8ef-98b5-48f3-a1a8-6bdafa0154d4 is going to be created. [ 1327.482473] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.482685] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.482818] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.483083] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.483320] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.483545] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-0641d8ef-98b5-48f3-a1a8-6bdafa0154d4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.122938] env[70006]: INFO networking_nsxv3.common.synchronization [req-b251bd18-d200-4244-8a49-3a6097414365 req-5e7ffe31-a18a-439b-ab06-f3de66a1b626 service nova] Enqueued Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGHEST for action security_group_rules [ 1328.123208] env[70006]: INFO networking_nsxv3.common.synchronization [req-b251bd18-d200-4244-8a49-3a6097414365 req-5e7ffe31-a18a-439b-ab06-f3de66a1b626 service nova] Enqueued Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGHEST for action security_group_members [ 1328.123271] env[70006]: INFO networking_nsxv3.common.synchronization [req-b251bd18-d200-4244-8a49-3a6097414365 req-5e7ffe31-a18a-439b-ab06-f3de66a1b626 service nova] Enqueued Resource ID: 0641d8ef-98b5-48f3-a1a8-6bdafa0154d4 with Priority: HIGHEST for action port [ 1328.123740] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGHEST for action security_group_rules [ 1328.123932] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGHEST for action security_group_members [ 1328.123967] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0641d8ef-98b5-48f3-a1a8-6bdafa0154d4 with Priority: HIGHEST for action port [ 1328.124269] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0646470-1725-4121-8506-f62005f5ece8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.124343] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.124414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.124663] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.124746] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0646470-1725-4121-8506-f62005f5ece8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.125560] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0646470-1725-4121-8506-f62005f5ece8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.125693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.125767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.125931] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.126087] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.126192] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.126253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.126394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.126480] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.126561] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0646470-1725-4121-8506-f62005f5ece8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.127269] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-0641d8ef-98b5-48f3-a1a8-6bdafa0154d4 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.127378] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0641d8ef-98b5-48f3-a1a8-6bdafa0154d4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.127446] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0641d8ef-98b5-48f3-a1a8-6bdafa0154d4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.127595] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0641d8ef-98b5-48f3-a1a8-6bdafa0154d4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.127692] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0641d8ef-98b5-48f3-a1a8-6bdafa0154d4',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.630528] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0646470-1725-4121-8506-f62005f5ece8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.630528] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.630528] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0646470-1725-4121-8506-f62005f5ece8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.631117] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0641d8ef-98b5-48f3-a1a8-6bdafa0154d4 with status ACTIVE [ 1328.631117] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.631259] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.631302] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.631498] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.631641] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.631726] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.631811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.631869] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.632037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.632110] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.632289] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.632383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.632447] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.632578] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.632654] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.632737] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0641d8ef-98b5-48f3-a1a8-6bdafa0154d4 is going to be updated. [ 1328.653473] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.653651] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.653691] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.653866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.653998] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.654169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0641d8ef-98b5-48f3-a1a8-6bdafa0154d4" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.134627] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0646470-1725-4121-8506-f62005f5ece8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.637270] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.637482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.637482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.637702] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.637794] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.637894] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0646470-1725-4121-8506-f62005f5ece8 is going to be created. [ 1329.661358] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.661560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.661560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.661765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.661925] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.670438] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0646470-1725-4121-8506-f62005f5ece8 in Status: UNINITIALIZED for 2s [ 1331.683341] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0646470-1725-4121-8506-f62005f5ece8 in Status: SUCCESS [ 1331.683642] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.683831] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.684070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.684269] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.684388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.684456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.684636] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.684726] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.684812] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.684903] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0646470-1725-4121-8506-f62005f5ece8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.187947] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0646470-1725-4121-8506-f62005f5ece8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.690426] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0646470-1725-4121-8506-f62005f5ece8: rpc.has_security_group_logging(os_id): False [ 1332.711608] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.711842] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.711842] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.712084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.712189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.712442] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.712557] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.712650] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.712827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.712931] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.713017] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0646470-1725-4121-8506-f62005f5ece8 is going to be created. [ 1332.780550] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.780550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.780550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.780550] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.780939] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.793279] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0646470-1725-4121-8506-f62005f5ece8 in Status: IN_PROGRESS for 2s [ 1333.124647] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1333.124868] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1333.845877] env[70006]: INFO networking_nsxv3.common.synchronization [req-49759526-50d3-465a-97fc-3a94ef452e10 req-0bf4b145-bd3f-44c8-87ff-05f4574b4971 tempest-ServerActionsTestJSON-71305913 tempest-ServerActionsTestJSON-71305913-project-member] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 1333.846497] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGHEST for action security_group_members [ 1333.847397] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.847866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.847866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.847866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.848042] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.848097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.848135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.848270] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.848359] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.848458] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.351358] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.351576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.351576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.351861] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.351945] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.352133] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.352235] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.352302] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.352460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.352558] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.352649] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c is going to be updated. [ 1334.381213] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.381421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.381421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.381654] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.381770] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.390616] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: IN_PROGRESS for 2s [ 1334.806609] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0646470-1725-4121-8506-f62005f5ece8 in Status: SUCCESS [ 1334.806847] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.400602] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c in Status: SUCCESS [ 1336.400602] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c deletion is rescheduled due to dependency. [ 1336.400602] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.847351] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1338.847697] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1341.399658] env[70006]: INFO networking_nsxv3.common.synchronization [None req-fc0d5e3f-6523-49eb-8b78-fbe25c06e2ed None None] Enqueued Resource ID: e525f321-5eb1-4244-9726-febc07f0855a with Priority: HIGHEST for action port [ 1341.400216] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e525f321-5eb1-4244-9726-febc07f0855a with Priority: HIGHEST for action port [ 1341.400530] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-e525f321-5eb1-4244-9726-febc07f0855a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.400685] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e525f321-5eb1-4244-9726-febc07f0855a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.400743] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e525f321-5eb1-4244-9726-febc07f0855a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.400965] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e525f321-5eb1-4244-9726-febc07f0855a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.401059] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e525f321-5eb1-4244-9726-febc07f0855a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.852365] env[70006]: INFO networking_nsxv3.common.synchronization [None req-ba947230-cbac-4baf-b0f4-14490f90bce8 tempest-ServerActionsTestOtherA-1491726041 tempest-ServerActionsTestOtherA-1491726041-project-member] Enqueued Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_rules [ 1341.852649] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_rules [ 1341.852960] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.853189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.853189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.853412] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.853497] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.904329] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e525f321-5eb1-4244-9726-febc07f0855a [ 1341.904329] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.904329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.904329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.904329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.904329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.904329] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e525f321-5eb1-4244-9726-febc07f0855a already deleted. [ 1341.904329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e525f321-5eb1-4244-9726-febc07f0855a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.929017] env[70006]: INFO networking_nsxv3.common.synchronization [None req-7dcd664e-acef-4441-b6a5-951c24db57f7 tempest-ServerActionsTestOtherA-1491726041 tempest-ServerActionsTestOtherA-1491726041-project-member] Enqueued Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_rules [ 1341.929017] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_rules [ 1341.929017] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.929017] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.375076] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.375223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.375318] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.375506] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.375593] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.375720] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 already deleted. [ 1342.375823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.375954] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.376129] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.376218] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.895842] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.896175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.896175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.896292] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.896378] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.896474] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 already deleted. [ 1342.896556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.578367] env[70006]: INFO networking_nsxv3.common.synchronization [None req-d1b4802f-bdc2-479b-8305-39ecfe2bab0a None None] Enqueued Resource ID: ffbaef0e-b280-45d7-a317-b6bfaca37ec9 with Priority: HIGHEST for action port [ 1343.578876] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffbaef0e-b280-45d7-a317-b6bfaca37ec9 with Priority: HIGHEST for action port [ 1343.579199] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffbaef0e-b280-45d7-a317-b6bfaca37ec9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.579320] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffbaef0e-b280-45d7-a317-b6bfaca37ec9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.579388] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffbaef0e-b280-45d7-a317-b6bfaca37ec9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.579634] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffbaef0e-b280-45d7-a317-b6bfaca37ec9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.579717] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffbaef0e-b280-45d7-a317-b6bfaca37ec9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.082428] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffbaef0e-b280-45d7-a317-b6bfaca37ec9 [ 1344.082785] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.082846] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.082920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.083276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.083399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.083505] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffbaef0e-b280-45d7-a317-b6bfaca37ec9 already deleted. [ 1344.083618] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffbaef0e-b280-45d7-a317-b6bfaca37ec9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.307048] env[70006]: INFO networking_nsxv3.common.synchronization [req-d69288dd-7487-4a3d-ba74-2d44c15e0443 req-ba93f936-3c25-42b5-a803-7dab98254c43 tempest-ServerActionsTestOtherA-1491726041 tempest-ServerActionsTestOtherA-1491726041-project-member] Enqueued Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_members [ 1347.307584] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_members [ 1347.307956] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.308097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.308195] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.308534] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.308777] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.308888] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.308952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.309125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.309208] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.309301] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.596578] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.596783] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.596918] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.597270] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.597541] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.597706] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.597828] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.598061] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.598211] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.598422] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1347.598539] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1347.598652] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1347.598790] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1347.598917] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1347.599039] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1347.599175] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1347.622529] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1347.622812] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1347.623012] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1347.623244] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.623581] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-09fcfde5-581c-45f5-94e0-d8ed1b20d071 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.623763] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-09fcfde5-581c-45f5-94e0-d8ed1b20d071" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.623891] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-09fcfde5-581c-45f5-94e0-d8ed1b20d071" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.624276] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-09fcfde5-581c-45f5-94e0-d8ed1b20d071" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.624436] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09fcfde5-581c-45f5-94e0-d8ed1b20d071',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.812019] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.812219] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.812256] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.812472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.812565] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.812849] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.812996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.813091] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.813258] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.813339] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.813456] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 already deleted. [ 1347.813548] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.126718] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.126941] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.127015] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.127388] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.127549] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.127710] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 09fcfde5-581c-45f5-94e0-d8ed1b20d071 not found, creating... [ 1348.127991] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.128175] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.128301] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.128536] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.128678] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.128958] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.129133] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.129256] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.129465] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.129602] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.129745] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 09fcfde5-581c-45f5-94e0-d8ed1b20d071 is going to be created. [ 1348.149039] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.149261] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.149385] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.149663] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.149901] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.150167] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-09fcfde5-581c-45f5-94e0-d8ed1b20d071" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.034522] env[70006]: INFO networking_nsxv3.common.synchronization [req-d69288dd-7487-4a3d-ba74-2d44c15e0443 req-d81619fa-37d6-4d39-a01f-f5134044a14e service nova] Enqueued Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_rules [ 1349.034850] env[70006]: INFO networking_nsxv3.common.synchronization [req-d69288dd-7487-4a3d-ba74-2d44c15e0443 req-d81619fa-37d6-4d39-a01f-f5134044a14e service nova] Enqueued Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_members [ 1349.034886] env[70006]: INFO networking_nsxv3.common.synchronization [req-d69288dd-7487-4a3d-ba74-2d44c15e0443 req-d81619fa-37d6-4d39-a01f-f5134044a14e service nova] Enqueued Resource ID: 09fcfde5-581c-45f5-94e0-d8ed1b20d071 with Priority: HIGHEST for action port [ 1349.035149] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_rules [ 1349.035292] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_members [ 1349.035391] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09fcfde5-581c-45f5-94e0-d8ed1b20d071 with Priority: HIGHEST for action port [ 1349.035940] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.036161] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.036243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.036768] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.036768] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.037325] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.037430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.037498] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.037655] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.037793] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.037892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.037938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.038076] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.038160] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.038248] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.038949] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-09fcfde5-581c-45f5-94e0-d8ed1b20d071 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.039069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09fcfde5-581c-45f5-94e0-d8ed1b20d071" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.039135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09fcfde5-581c-45f5-94e0-d8ed1b20d071" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.039282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09fcfde5-581c-45f5-94e0-d8ed1b20d071" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.039520] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09fcfde5-581c-45f5-94e0-d8ed1b20d071',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.541486] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.541700] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.543406] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.544457] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09fcfde5-581c-45f5-94e0-d8ed1b20d071 with status ACTIVE [ 1349.544675] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.544821] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.544897] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.545131] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.545225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.545404] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.545505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.545567] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.545717] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.545820] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.546014] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.546121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.546183] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.546324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.546399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.546480] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09fcfde5-581c-45f5-94e0-d8ed1b20d071 is going to be updated. [ 1349.568916] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.569134] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.569134] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.569337] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.569469] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.569620] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09fcfde5-581c-45f5-94e0-d8ed1b20d071" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.048534] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.551624] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.551868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.551868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.552242] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.552380] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.552508] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 is going to be created. [ 1350.578471] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.578706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.578756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.578963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.579142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.588103] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: UNINITIALIZED for 2s [ 1352.598608] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: SUCCESS [ 1352.599221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.599221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.599221] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.599452] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.599452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.599629] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.599682] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.599729] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.599821] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.599889] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.102421] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.604992] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7afc3b6e-6fd7-4d5f-907e-545cb98529e5: rpc.has_security_group_logging(os_id): False [ 1353.622778] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.623075] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.623075] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.623200] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.623291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.623540] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.623640] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.623704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.623876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.623949] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.624048] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 is going to be created. [ 1353.681914] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.682266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.682266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.682386] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.682524] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.700806] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: IN_PROGRESS for 2s [ 1354.036839] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1354.037097] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1355.713150] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: SUCCESS [ 1355.713569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.016268] env[70006]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1359.016671] env[70006]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] NSXv3 Agent Agent loop - iteration:3 started [ 1359.038386] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1359.038518] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1364.039668] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.040068] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1369.041042] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.041396] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1374.042733] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1374.042733] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1379.043503] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.043503] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1384.044055] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.044471] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1389.045651] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.045651] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1394.046347] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1394.046729] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.838526] env[70006]: INFO networking_nsxv3.common.synchronization [req-77c0b80f-e556-41c2-8a90-1b5ee48c173c req-25cd150e-9869-4596-8174-af4abde19aec tempest-ServerActionsTestOtherA-1491726041 tempest-ServerActionsTestOtherA-1491726041-project-member] Enqueued Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_members [ 1398.838909] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_members [ 1398.839261] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.839386] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.839448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.839696] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.839853] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.839963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.840061] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.840324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.840416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.840514] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.121525] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.121799] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.121918] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.122209] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.122488] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.122646] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.122771] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.122994] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.123171] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.123400] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1399.123515] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1399.123626] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1399.123774] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1399.123953] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1399.124096] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1399.124248] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1399.153641] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1399.153972] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1399.154098] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1399.154205] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.154541] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-94489867-3216-44ac-bd4b-224974ef5c89 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.154719] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-94489867-3216-44ac-bd4b-224974ef5c89" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.154878] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-94489867-3216-44ac-bd4b-224974ef5c89" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.155247] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-94489867-3216-44ac-bd4b-224974ef5c89" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.155430] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94489867-3216-44ac-bd4b-224974ef5c89',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.343242] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.343454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.343504] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.343722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.343851] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.344044] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.344158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.344201] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.344357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.344435] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.344521] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 already deleted. [ 1399.344604] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.658577] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.658792] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.658886] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.659221] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.659387] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.659552] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 94489867-3216-44ac-bd4b-224974ef5c89 not found, creating... [ 1399.659823] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.659991] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.660135] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.660371] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.660531] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.660818] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.660979] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.661121] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.661383] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.661547] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.661698] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 94489867-3216-44ac-bd4b-224974ef5c89 is going to be created. [ 1399.684206] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.684423] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.684536] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.684822] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.685079] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.685381] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-94489867-3216-44ac-bd4b-224974ef5c89" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.351561] env[70006]: INFO networking_nsxv3.common.synchronization [req-77c0b80f-e556-41c2-8a90-1b5ee48c173c req-4ca4988e-2cf6-4606-92dd-d7cb7fdb9cd8 service nova] Enqueued Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_rules [ 1400.351829] env[70006]: INFO networking_nsxv3.common.synchronization [req-77c0b80f-e556-41c2-8a90-1b5ee48c173c req-4ca4988e-2cf6-4606-92dd-d7cb7fdb9cd8 service nova] Enqueued Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_members [ 1400.351873] env[70006]: INFO networking_nsxv3.common.synchronization [req-77c0b80f-e556-41c2-8a90-1b5ee48c173c req-4ca4988e-2cf6-4606-92dd-d7cb7fdb9cd8 service nova] Enqueued Resource ID: 94489867-3216-44ac-bd4b-224974ef5c89 with Priority: HIGHEST for action port [ 1400.352112] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_rules [ 1400.352249] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_members [ 1400.352343] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94489867-3216-44ac-bd4b-224974ef5c89 with Priority: HIGHEST for action port [ 1400.352878] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.353101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.353218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.353592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.353723] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.354818] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.354879] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.354955] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.355128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.355397] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.355397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.355538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.355606] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.355690] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.355779] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.356947] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-94489867-3216-44ac-bd4b-224974ef5c89 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.357086] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94489867-3216-44ac-bd4b-224974ef5c89" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.357160] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94489867-3216-44ac-bd4b-224974ef5c89" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.357312] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94489867-3216-44ac-bd4b-224974ef5c89" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.357389] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94489867-3216-44ac-bd4b-224974ef5c89',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.859035] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.859187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.859388] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.860337] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94489867-3216-44ac-bd4b-224974ef5c89 with status ACTIVE [ 1400.860920] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.860920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.860920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.860920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.861190] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.861190] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.861269] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.861306] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.861430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.861507] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.861682] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.861773] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.861835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.861972] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.862059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.862144] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94489867-3216-44ac-bd4b-224974ef5c89 is going to be updated. [ 1400.883716] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.883919] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.883919] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.884149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.884287] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.884444] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94489867-3216-44ac-bd4b-224974ef5c89" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.364555] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.867216] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.867453] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.867453] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.867679] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.867776] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.867882] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 is going to be created. [ 1401.898398] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.898635] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.898635] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.898810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.898973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.908893] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: UNINITIALIZED for 2s [ 1403.920509] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: SUCCESS [ 1403.920781] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.920898] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.921145] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.921346] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.921464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.921522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.921688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.921839] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.921888] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.921941] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.425662] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.425662] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.425662] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.426039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.426367] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.426480] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.426516] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.426752] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.426892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.427053] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.427280] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.427422] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.427519] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.427735] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.427944] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.428102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.428200] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.428412] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.428528] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.428649] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.428786] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.931813] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9e6cc58-af30-43eb-9095-6f3fa07f74c8: rpc.has_security_group_logging(os_id): False [ 1404.942986] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.943211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.943211] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.943479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.943593] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.950107] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.950288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.950418] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.950610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.950765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.950995] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.951133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.951203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.951402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.951511] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.951747] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.951852] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.951912] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.952106] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.952241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.952458] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.952554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.952616] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.952756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.952830] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.952914] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 is going to be created. [ 1405.020093] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.020273] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.020356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.020523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.020703] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.032750] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: IN_PROGRESS for 2s [ 1405.353532] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.353756] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1405.446407] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.948475] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.451516] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1406.451645] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1407.062227] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: SUCCESS [ 1407.062626] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.352057] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.352057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.352314] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.352432] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.366936] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1407.367873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.368769] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1407.406478] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.406714] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.406714] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.406931] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.417743] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.418344] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1407.418429] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1407.418519] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1407.449440] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.449660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.449660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.449840] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.450588] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.450744] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1407.524056] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.524056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.524056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.524056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.524621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.524621] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1407.601737] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.602017] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.602017] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.602175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.602448] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.602719] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:23. [ 1407.602808] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'52f8f7d9-4c0c-462c-8639-ee701cd7952b', '7afc3b6e-6fd7-4d5f-907e-545cb98529e5', 'a9e6cc58-af30-43eb-9095-6f3fa07f74c8', 'f0646470-1725-4121-8506-f62005f5ece8', '28b8ed16-99b8-40b6-8095-2254b0cf928c', '4a1f4e07-2a71-4bf1-8382-753fd9965928', 'bcb3911f-9d2b-45be-a214-581dc745aaa9', '7dabf6a4-a7d4-4bc7-a18c-73081fea1de5', 'cefeff63-e154-425d-8ffe-56cc092db146', 'e9bd1969-8f85-4f80-a738-0f3c9578a25c', '946a4bb3-35a7-45bf-b93f-0879f8e48ab0', '6d10f346-7e60-4bf9-a322-b64cbffea871', '2d0a478f-3de2-453c-980b-25efdb42c355', 'e45746ed-781c-4f14-807a-e9e8876db03b', '5b2723f9-b1dc-419e-b339-13aae985829f', 'cb1869c6-76a1-476b-ae81-d81b81b97f5a', '8a4e3fb3-c949-45ee-b225-af03d5526168', '152fa45c-61d1-4b26-872b-ee9494b58bea', 'ce0190ac-bf23-4a10-82de-268e3bc82647', 'a5bdfda1-5bdc-410b-ab38-e2b0315faa59', 'a703014b-177b-46b0-a1e5-010ba0dfd415', 'b62110f9-4181-4c43-9e99-43fd5dff214d', '6541dc4e-5278-42ae-bed3-8ae1f828bb0f'} {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1407.602895] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1407.622801] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.623034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.623034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.623231] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.623319] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.623430] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1407.623503] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1407.623573] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1407.696184] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.696505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.696505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.696625] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.697568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.697805] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1407.697889] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1407.697973] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1407.698038] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1407.698107] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/23 resources of Type:Security Group Rules [ 1407.698177] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGH for action security_group_rules [ 1407.698233] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGH for action security_group_rules [ 1407.698295] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGH for action security_group_rules [ 1407.698363] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGH for action security_group_rules [ 1407.698421] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGH for action security_group_rules [ 1407.698471] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGH for action security_group_rules [ 1407.698522] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGH for action security_group_rules [ 1407.698574] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGH for action security_group_rules [ 1407.698641] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cefeff63-e154-425d-8ffe-56cc092db146 with Priority: HIGH for action security_group_rules [ 1407.698691] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c with Priority: HIGH for action security_group_rules [ 1407.698734] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 with Priority: HIGH for action security_group_rules [ 1407.698802] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 with Priority: HIGH for action security_group_rules [ 1407.698857] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2d0a478f-3de2-453c-980b-25efdb42c355 with Priority: HIGH for action security_group_rules [ 1407.698912] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e45746ed-781c-4f14-807a-e9e8876db03b with Priority: HIGH for action security_group_rules [ 1407.698984] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGH for action security_group_rules [ 1407.699047] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGH for action security_group_rules [ 1407.699099] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 with Priority: HIGH for action security_group_rules [ 1407.699146] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGH for action security_group_rules [ 1407.699199] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce0190ac-bf23-4a10-82de-268e3bc82647 with Priority: HIGH for action security_group_rules [ 1407.699248] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGH for action security_group_rules [ 1407.699343] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.355284] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.355801] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1410.355801] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b with Priority: HIGH for action security_group_rules [ 1410.355801] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGH for action security_group_rules [ 1410.355801] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 with Priority: HIGH for action security_group_rules [ 1410.356025] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b2723f9-b1dc-419e-b339-13aae985829f with Priority: HIGH for action security_group_rules [ 1410.356025] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 with Priority: HIGH for action security_group_rules [ 1410.356025] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce0190ac-bf23-4a10-82de-268e3bc82647 with Priority: HIGH for action security_group_rules [ 1410.356144] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152fa45c-61d1-4b26-872b-ee9494b58bea with Priority: HIGH for action security_group_rules [ 1410.356210] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 with Priority: HIGH for action security_group_rules [ 1410.356295] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45746ed-781c-4f14-807a-e9e8876db03b with Priority: HIGH for action security_group_rules [ 1410.356385] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a with Priority: HIGH for action security_group_rules [ 1410.356484] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d0a478f-3de2-453c-980b-25efdb42c355 with Priority: HIGH for action security_group_rules [ 1410.356586] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 with Priority: HIGH for action security_group_rules [ 1410.356676] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 with Priority: HIGH for action security_group_rules [ 1410.356769] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c with Priority: HIGH for action security_group_rules [ 1410.356853] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cefeff63-e154-425d-8ffe-56cc092db146 with Priority: HIGH for action security_group_rules [ 1410.356937] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 with Priority: HIGH for action security_group_rules [ 1410.357034] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 with Priority: HIGH for action security_group_rules [ 1410.357131] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c with Priority: HIGH for action security_group_rules [ 1410.357276] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGH for action security_group_rules [ 1410.357413] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGH for action security_group_rules [ 1410.357764] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.357891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.357973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.358181] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.358266] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52f8f7d9-4c0c-462c-8639-ee701cd7952b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.359284] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.359400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.359472] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.359672] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.359752] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.360539] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcb3911f-9d2b-45be-a214-581dc745aaa9 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.361163] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.361163] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.361163] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.361163] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcb3911f-9d2b-45be-a214-581dc745aaa9',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.361944] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b2723f9-b1dc-419e-b339-13aae985829f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.361944] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.361944] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.362290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.362290] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b2723f9-b1dc-419e-b339-13aae985829f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.362820] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.362952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.363036] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.363142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.363232] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5bdfda1-5bdc-410b-ab38-e2b0315faa59',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.363891] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce0190ac-bf23-4a10-82de-268e3bc82647 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.364030] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.364108] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.364199] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.364270] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce0190ac-bf23-4a10-82de-268e3bc82647',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.364931] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-152fa45c-61d1-4b26-872b-ee9494b58bea taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.365080] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.365080] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.365290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.365290] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('152fa45c-61d1-4b26-872b-ee9494b58bea',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.366104] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a4e3fb3-c949-45ee-b225-af03d5526168 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.366233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.366309] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.366414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.366502] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a4e3fb3-c949-45ee-b225-af03d5526168',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.367169] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e45746ed-781c-4f14-807a-e9e8876db03b taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.367311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.367385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.367461] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.367525] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e45746ed-781c-4f14-807a-e9e8876db03b',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.368196] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.368322] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.368399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.368503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.368580] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1869c6-76a1-476b-ae81-d81b81b97f5a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.369225] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d0a478f-3de2-453c-980b-25efdb42c355 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.369361] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.369440] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.369548] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.369620] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d0a478f-3de2-453c-980b-25efdb42c355',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.370375] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d10f346-7e60-4bf9-a322-b64cbffea871 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.370504] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.370579] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.370691] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.370764] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d10f346-7e60-4bf9-a322-b64cbffea871',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.371412] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-946a4bb3-35a7-45bf-b93f-0879f8e48ab0 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.371544] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.371544] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.371688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.371751] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('946a4bb3-35a7-45bf-b93f-0879f8e48ab0',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.372408] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9bd1969-8f85-4f80-a738-0f3c9578a25c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.372503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.372567] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.372809] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.372899] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9bd1969-8f85-4f80-a738-0f3c9578a25c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.375126] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cefeff63-e154-425d-8ffe-56cc092db146 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.375266] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.375333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.375466] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.375543] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cefeff63-e154-425d-8ffe-56cc092db146',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.376386] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a1f4e07-2a71-4bf1-8382-753fd9965928 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.376518] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.376587] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.376720] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.376794] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a1f4e07-2a71-4bf1-8382-753fd9965928',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.377443] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.377560] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.377616] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.377754] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.377820] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dabf6a4-a7d4-4bc7-a18c-73081fea1de5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.378488] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28b8ed16-99b8-40b6-8095-2254b0cf928c taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.378613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.378681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.378813] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.378884] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28b8ed16-99b8-40b6-8095-2254b0cf928c',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.379644] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.379783] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.379783] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.380025] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.380025] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.380651] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0646470-1725-4121-8506-f62005f5ece8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.380765] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.380823] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.380958] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.381037] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0646470-1725-4121-8506-f62005f5ece8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.404149] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.404392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.404392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.404567] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.407729] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.407905] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.429347] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.429539] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcb3911f-9d2b-45be-a214-581dc745aaa9 is going to be deleted. [ 1410.430378] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.430592] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.450989] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.451181] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e45746ed-781c-4f14-807a-e9e8876db03b is going to be deleted. [ 1410.485165] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.485446] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.485446] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.485621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.485715] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.485837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcb3911f-9d2b-45be-a214-581dc745aaa9" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.502715] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.502918] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.502918] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.503127] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.503218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.503345] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e45746ed-781c-4f14-807a-e9e8876db03b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.885193] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.885427] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.885501] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.885764] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.885826] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.885920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.885981] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.886148] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.886233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.886320] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.886423] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.898483] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.898659] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.898704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.898874] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.899045] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.899146] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.899208] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.899354] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.899459] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.899519] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.899607] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.902443] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0646470-1725-4121-8506-f62005f5ece8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.902633] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.902633] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.902776] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.902919] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.903024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.903084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.903222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.903306] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.903403] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.903502] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0646470-1725-4121-8506-f62005f5ece8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.916608] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0646470-1725-4121-8506-f62005f5ece8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.944717] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.944865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.944980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.945159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.994667] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.994667] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.995536] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.995639] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.996440] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.996549] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.997314] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.997461] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.998143] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.998272] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.998607] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.998725] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.999408] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.999507] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.000239] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.000353] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.001225] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.001325] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.002080] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.002185] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.002825] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1411.003233] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.003347] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.003963] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1411.004366] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.004489] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.005020] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1411.005472] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.005573] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.006496] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1411.006887] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.006973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.012019] env[70006]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1411.012499] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.012618] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b2723f9-b1dc-419e-b339-13aae985829f is going to be deleted. [ 1411.013562] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.013769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.055014] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.055173] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d10f346-7e60-4bf9-a322-b64cbffea871 is going to be deleted. [ 1411.056208] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.056524] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.079386] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.079621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.081885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.082011] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a1f4e07-2a71-4bf1-8382-753fd9965928 is going to be deleted. [ 1411.082828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.083569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.109162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.109330] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52f8f7d9-4c0c-462c-8639-ee701cd7952b is going to be deleted. [ 1411.110226] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.110505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.128797] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.129028] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.134713] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.134902] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a4e3fb3-c949-45ee-b225-af03d5526168 is going to be deleted. [ 1411.135825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.136058] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.176822] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.177067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.183245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.183425] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28b8ed16-99b8-40b6-8095-2254b0cf928c is going to be deleted. [ 1411.184464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.184712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.187179] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.187350] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.227042] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.227247] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.230780] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.230933] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d0a478f-3de2-453c-980b-25efdb42c355 is going to be deleted. [ 1411.231873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.232116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.287207] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.287378] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9bd1969-8f85-4f80-a738-0f3c9578a25c is going to be deleted. [ 1411.288414] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.288631] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.366839] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.367249] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.367711] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.367812] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.374797] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.374967] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5bdfda1-5bdc-410b-ab38-e2b0315faa59 is going to be deleted. [ 1411.375866] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.376098] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.390957] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.407452] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.407617] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 152fa45c-61d1-4b26-872b-ee9494b58bea is going to be deleted. [ 1411.408539] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.408768] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.411726] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.411873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.411908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.412148] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.412320] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.412424] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.412484] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.412642] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.412768] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.412810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.412950] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.413050] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.413101] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.413240] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.413407] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.413476] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.413542] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.413666] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.413762] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.413859] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.413950] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.425096] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0646470-1725-4121-8506-f62005f5ece8: rpc.has_security_group_logging(os_id): False [ 1411.457857] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.458103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.467979] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.468176] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.490952] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.491157] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dabf6a4-a7d4-4bc7-a18c-73081fea1de5 is going to be deleted. [ 1411.492079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.492323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.505903] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.506121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.550341] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.550551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.582787] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.582959] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 946a4bb3-35a7-45bf-b93f-0879f8e48ab0 is going to be deleted. [ 1411.584014] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.584243] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.646180] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.646379] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.658289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.658469] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cefeff63-e154-425d-8ffe-56cc092db146 is going to be deleted. [ 1411.659384] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.659621] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.708726] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.708898] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce0190ac-bf23-4a10-82de-268e3bc82647 is going to be deleted. [ 1411.709826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.710059] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.743545] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.743756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.779556] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.779733] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1869c6-76a1-476b-ae81-d81b81b97f5a is going to be deleted. [ 1411.780638] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.780865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.780962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.781100] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b2723f9-b1dc-419e-b339-13aae985829f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.781262] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.781419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.781499] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.781632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d10f346-7e60-4bf9-a322-b64cbffea871" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.782167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.782327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.782417] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.782528] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a1f4e07-2a71-4bf1-8382-753fd9965928" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.782662] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.782815] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.782878] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.782995] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52f8f7d9-4c0c-462c-8639-ee701cd7952b" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.783187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.783325] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.783407] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.783576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a4e3fb3-c949-45ee-b225-af03d5526168" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.783640] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.783766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.783843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.783973] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28b8ed16-99b8-40b6-8095-2254b0cf928c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.784186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.784429] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.784484] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.784561] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d0a478f-3de2-453c-980b-25efdb42c355" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.784687] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.784828] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.837965] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.838168] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.848482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.848893] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.848996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.849126] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.849288] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.849373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.849469] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0646470-1725-4121-8506-f62005f5ece8 is going to be updated. [ 1411.850587] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.850761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.850852] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.850970] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9bd1969-8f85-4f80-a738-0f3c9578a25c" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.851131] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.851280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.851361] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.851477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5bdfda1-5bdc-410b-ab38-e2b0315faa59" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.851663] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.851812] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.851892] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.852015] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-152fa45c-61d1-4b26-872b-ee9494b58bea" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.852142] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.852279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.852357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.852471] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dabf6a4-a7d4-4bc7-a18c-73081fea1de5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.853037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.853223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.853361] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.853488] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-946a4bb3-35a7-45bf-b93f-0879f8e48ab0" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.853617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.853806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.853898] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.854051] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cefeff63-e154-425d-8ffe-56cc092db146" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.884488] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.884784] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.884860] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.885168] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.885420] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.885510] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce0190ac-bf23-4a10-82de-268e3bc82647" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.893113] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7afc3b6e-6fd7-4d5f-907e-545cb98529e5: rpc.has_security_group_logging(os_id): False [ 1411.916608] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9e6cc58-af30-43eb-9095-6f3fa07f74c8: rpc.has_security_group_logging(os_id): False [ 1411.961039] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.961039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.961039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.961039] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.971850] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.972137] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.986060] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.986262] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.995968] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.996144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.007845] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.008240] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.008361] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.008420] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.008806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.008806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.008806] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 is going to be updated. [ 1412.009940] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.010131] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.075133] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.075472] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.075687] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.075687] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.075885] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.075947] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.076159] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.076258] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.076307] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.076454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.076540] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.076744] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.076825] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.076906] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.077031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.077122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.077204] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 is going to be updated. [ 1412.078464] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.078630] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.078772] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.079752] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.079916] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.080009] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.080213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1869c6-76a1-476b-ae81-d81b81b97f5a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.129096] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0646470-1725-4121-8506-f62005f5ece8 in Status: IN_PROGRESS for 2s [ 1412.190134] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.190351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.190522] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.190809] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.191093] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.230112] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: IN_PROGRESS for 2s [ 1412.259622] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.259886] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.260031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.260368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.260635] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.316781] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: IN_PROGRESS for 2s [ 1414.143056] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0646470-1725-4121-8506-f62005f5ece8 in Status: SUCCESS [ 1414.143056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.243533] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: SUCCESS [ 1414.243787] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.337726] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: SUCCESS [ 1414.338019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.359124] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1415.359552] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1420.360127] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.360522] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1424.384476] env[70006]: INFO networking_nsxv3.common.synchronization [req-be793570-6671-4b6c-95fd-6bad0d41477d req-a0943163-0d7d-4376-8690-d56e5e1db0ef tempest-ServerActionsTestOtherA-1491726041 tempest-ServerActionsTestOtherA-1491726041-project-member] Enqueued Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_members [ 1424.384855] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_members [ 1424.385173] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.385234] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.385323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.385540] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.385694] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.385796] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.385853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.386017] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.386110] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.386206] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.888906] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.889167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.889167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.889385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.889478] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.889686] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.889790] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.889854] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.890027] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.890102] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.890194] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 is going to be updated. [ 1424.936350] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.936581] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.936581] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.936674] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.936816] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.946536] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: IN_PROGRESS for 2s [ 1426.959628] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: SUCCESS [ 1426.959628] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 deletion is rescheduled due to dependency. [ 1426.959628] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.386630] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1429.386884] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1429.545295] env[70006]: INFO networking_nsxv3.common.synchronization [None req-b3a50eb5-cccc-4721-ae6f-caef5646a336 tempest-ServerActionsTestOtherA-1491726041 tempest-ServerActionsTestOtherA-1491726041-project-member] Enqueued Resource ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f with Priority: HIGHEST for action security_group_rules [ 1429.545859] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f with Priority: HIGHEST for action security_group_rules [ 1429.546169] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.546287] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.546348] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.546631] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.546755] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ac4e5f7-9493-4d97-8c74-901ee541f00f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.617102] env[70006]: INFO networking_nsxv3.common.synchronization [None req-62f06c54-7f1a-474e-b4e5-97ff27c7bedc tempest-ServerActionsTestOtherA-1491726041 tempest-ServerActionsTestOtherA-1491726041-project-member] Enqueued Resource ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f with Priority: HIGHEST for action security_group_rules [ 1429.617593] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f with Priority: HIGHEST for action security_group_rules [ 1429.617903] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.618024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.068670] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.068843] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.068913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.069129] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.069208] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.069306] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f already deleted. [ 1430.069389] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.069532] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.069686] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.069760] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ac4e5f7-9493-4d97-8c74-901ee541f00f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.589858] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.590252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.590252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.590252] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.590366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.590470] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f already deleted. [ 1430.590513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.619016] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1434.619392] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1434.869208] env[70006]: INFO networking_nsxv3.common.synchronization [req-dfac7604-e97f-4111-9985-0627726cbbdb req-93a176f2-8bc1-4150-9e48-1de3fe99ef73 tempest-ServerActionsTestOtherA-1491726041 tempest-ServerActionsTestOtherA-1491726041-project-member] Enqueued Resource ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f with Priority: HIGHEST for action security_group_members [ 1434.869645] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f with Priority: HIGHEST for action security_group_members [ 1434.869920] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ac4e5f7-9493-4d97-8c74-901ee541f00f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.870056] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.870131] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.870376] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.870537] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.870677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.870749] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.870835] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.870910] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.871637] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ac4e5f7-9493-4d97-8c74-901ee541f00f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.128598] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.128598] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.128818] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.129071] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.129340] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.129516] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.129645] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.129878] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.130040] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.130269] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1435.130371] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1435.130486] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1435.130597] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1435.130711] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1435.130894] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1435.131300] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1435.155972] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1435.156166] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1435.156300] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1435.156473] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.156808] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-38eb2cd8-95d0-4914-b70f-32f33e352bb7 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.156961] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-38eb2cd8-95d0-4914-b70f-32f33e352bb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.157103] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-38eb2cd8-95d0-4914-b70f-32f33e352bb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.157437] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-38eb2cd8-95d0-4914-b70f-32f33e352bb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.157580] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38eb2cd8-95d0-4914-b70f-32f33e352bb7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.375036] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.375279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.375279] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.375439] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.375498] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.375781] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.375876] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.375949] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.376137] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.376278] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.376278] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f already deleted. [ 1435.376436] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.659555] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.659899] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.659948] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.660236] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.660399] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.660571] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 38eb2cd8-95d0-4914-b70f-32f33e352bb7 not found, creating... [ 1435.660851] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.661036] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.661165] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.661390] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.661592] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.661828] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.662036] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.662128] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.662347] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.662485] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.662636] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 38eb2cd8-95d0-4914-b70f-32f33e352bb7 is going to be created. [ 1435.685436] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.685630] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.685744] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.686026] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.686271] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.686497] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-38eb2cd8-95d0-4914-b70f-32f33e352bb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.350710] env[70006]: INFO networking_nsxv3.common.synchronization [req-dfac7604-e97f-4111-9985-0627726cbbdb req-7614fbc0-346d-42fa-bd37-4f8a63c63b9c service nova] Enqueued Resource ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f with Priority: HIGHEST for action security_group_rules [ 1436.350897] env[70006]: INFO networking_nsxv3.common.synchronization [req-dfac7604-e97f-4111-9985-0627726cbbdb req-7614fbc0-346d-42fa-bd37-4f8a63c63b9c service nova] Enqueued Resource ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f with Priority: HIGHEST for action security_group_members [ 1436.351051] env[70006]: INFO networking_nsxv3.common.synchronization [req-dfac7604-e97f-4111-9985-0627726cbbdb req-7614fbc0-346d-42fa-bd37-4f8a63c63b9c service nova] Enqueued Resource ID: 38eb2cd8-95d0-4914-b70f-32f33e352bb7 with Priority: HIGHEST for action port [ 1436.351530] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f with Priority: HIGHEST for action security_group_rules [ 1436.351664] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f with Priority: HIGHEST for action security_group_members [ 1436.351793] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38eb2cd8-95d0-4914-b70f-32f33e352bb7 with Priority: HIGHEST for action port [ 1436.352144] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.352302] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.352400] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.352629] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.352745] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ac4e5f7-9493-4d97-8c74-901ee541f00f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.353608] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ac4e5f7-9493-4d97-8c74-901ee541f00f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.353758] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.353856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.354074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.354264] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.354389] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.354477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.354650] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.354766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.354904] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ac4e5f7-9493-4d97-8c74-901ee541f00f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.355685] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-38eb2cd8-95d0-4914-b70f-32f33e352bb7 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.355988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38eb2cd8-95d0-4914-b70f-32f33e352bb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.355988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38eb2cd8-95d0-4914-b70f-32f33e352bb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.356100] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38eb2cd8-95d0-4914-b70f-32f33e352bb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.356196] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38eb2cd8-95d0-4914-b70f-32f33e352bb7',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.858197] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ac4e5f7-9493-4d97-8c74-901ee541f00f taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.858492] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.859787] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ac4e5f7-9493-4d97-8c74-901ee541f00f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.860599] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38eb2cd8-95d0-4914-b70f-32f33e352bb7 with status ACTIVE [ 1436.860730] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.860867] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.860938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.861160] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.861248] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.861431] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.861524] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.861583] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.861800] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.861908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.862053] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.862149] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.862209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.862349] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.862474] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.862526] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38eb2cd8-95d0-4914-b70f-32f33e352bb7 is going to be updated. [ 1436.884540] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.884761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.884761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.884951] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.885108] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.885261] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38eb2cd8-95d0-4914-b70f-32f33e352bb7" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.365061] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ac4e5f7-9493-4d97-8c74-901ee541f00f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.868276] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.868730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.868730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.868730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.868905] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.868905] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f is going to be created. [ 1437.891841] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.892086] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.892086] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.892274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.892433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.901593] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f in Status: UNINITIALIZED for 2s [ 1439.913736] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f in Status: SUCCESS [ 1439.913736] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.913736] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.914197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.914197] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.914328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.914420] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.914589] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.914673] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.914761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.914854] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ac4e5f7-9493-4d97-8c74-901ee541f00f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.417183] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ac4e5f7-9493-4d97-8c74-901ee541f00f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.920119] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ac4e5f7-9493-4d97-8c74-901ee541f00f: rpc.has_security_group_logging(os_id): False [ 1440.960915] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.961218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.961218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.961364] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.961449] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.961693] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.961791] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.961855] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.961999] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.962088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.962173] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f is going to be created. [ 1441.025153] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.025402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.025402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.025582] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.025812] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.037870] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f in Status: IN_PROGRESS for 2s [ 1441.352846] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.353072] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1443.051798] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f in Status: SUCCESS [ 1443.052290] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.354463] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.354826] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1451.356205] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.356581] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1456.357876] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1456.357876] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.359197] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1461.359603] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.360151] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.360561] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1471.361253] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.361253] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1474.520789] env[70006]: INFO networking_nsxv3.common.synchronization [req-2670d8c5-e3ee-4f7c-944a-2a6c1b094ca5 req-b9cb6e8c-432c-4f69-aa3c-ce9d85b7873e tempest-AttachVolumeTestJSON-389518749 tempest-AttachVolumeTestJSON-389518749-project-member] Enqueued Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGHEST for action security_group_members [ 1474.521338] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGHEST for action security_group_members [ 1474.521663] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0646470-1725-4121-8506-f62005f5ece8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.521801] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.521872] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.522097] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.522262] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.522383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.522505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.522732] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.522891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.523023] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0646470-1725-4121-8506-f62005f5ece8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.025478] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.025695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.025695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.025912] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.026042] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.026311] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.026454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.026561] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.026784] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.027121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.027121] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0646470-1725-4121-8506-f62005f5ece8 is going to be updated. [ 1475.058199] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.058430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.058430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.058610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.058749] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.067115] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0646470-1725-4121-8506-f62005f5ece8 in Status: IN_PROGRESS for 2s [ 1477.078399] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0646470-1725-4121-8506-f62005f5ece8 in Status: SUCCESS [ 1477.078759] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0646470-1725-4121-8506-f62005f5ece8 deletion is rescheduled due to dependency. [ 1477.078801] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.122326] env[70006]: INFO networking_nsxv3.common.synchronization [None req-6fd06d66-9d84-46a4-838a-5c19415c7d0c tempest-AttachVolumeTestJSON-389518749 tempest-AttachVolumeTestJSON-389518749-project-member] Enqueued Resource ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf with Priority: HIGHEST for action security_group_rules [ 1479.122899] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf with Priority: HIGHEST for action security_group_rules [ 1479.123223] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.123351] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.123419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.123673] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.123755] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f0e0261-a2f7-443c-bad6-28cf0dd63bdf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1479.194597] env[70006]: INFO networking_nsxv3.common.synchronization [None req-01054d5a-65d7-440d-9e75-3407af09ca30 tempest-AttachVolumeTestJSON-389518749 tempest-AttachVolumeTestJSON-389518749-project-member] Enqueued Resource ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf with Priority: HIGHEST for action security_group_rules [ 1479.195106] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf with Priority: HIGHEST for action security_group_rules [ 1479.195431] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.195531] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.643063] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.643063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.643063] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.643328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.643328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.643448] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf already deleted. [ 1479.643498] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.643637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.644209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.644209] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f0e0261-a2f7-443c-bad6-28cf0dd63bdf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1480.163825] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.164245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.164245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.164314] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.164419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.164502] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf already deleted. [ 1480.164597] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.195788] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1484.196245] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1484.568073] env[70006]: INFO networking_nsxv3.common.synchronization [req-5f590092-0338-4318-937d-9a6750a025cb req-838312e9-54ca-46a9-abbc-d60737f732f2 tempest-AttachVolumeTestJSON-389518749 tempest-AttachVolumeTestJSON-389518749-project-member] Enqueued Resource ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf with Priority: HIGHEST for action security_group_members [ 1484.568604] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf with Priority: HIGHEST for action security_group_members [ 1484.568908] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.569040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.569111] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.569360] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.569514] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.569615] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.569668] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.569810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.569890] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.569980] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f0e0261-a2f7-443c-bad6-28cf0dd63bdf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.837356] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-818 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.837592] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-818" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.837685] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-818" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.838274] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-818" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.838274] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.838490] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.838490] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.838688] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.838837] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.839058] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1484.839176] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1484.839289] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1484.839397] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1484.839504] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1484.839605] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1484.839732] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1484.860037] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1484.860238] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1484.860429] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1484.860622] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-818" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.860951] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-085bf42e-3339-4556-90f6-03e04a11cfb5 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.861149] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-085bf42e-3339-4556-90f6-03e04a11cfb5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.861277] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-085bf42e-3339-4556-90f6-03e04a11cfb5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.861620] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-085bf42e-3339-4556-90f6-03e04a11cfb5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.861764] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('085bf42e-3339-4556-90f6-03e04a11cfb5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1485.074193] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.074398] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.074438] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.074777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.074895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.075129] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.075241] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.075302] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.075460] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.075538] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.075624] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf already deleted. [ 1485.075706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.365061] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.365061] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.365061] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.365061] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.365061] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.365061] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 085bf42e-3339-4556-90f6-03e04a11cfb5 not found, creating... [ 1485.365631] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.365631] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.365631] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.365848] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.365986] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.366332] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.366511] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.366627] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.366925] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.367063] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.367261] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 085bf42e-3339-4556-90f6-03e04a11cfb5 is going to be created. [ 1485.388929] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.389203] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.389268] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.389538] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.389774] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.390048] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-085bf42e-3339-4556-90f6-03e04a11cfb5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.054972] env[70006]: INFO networking_nsxv3.common.synchronization [req-5f590092-0338-4318-937d-9a6750a025cb req-1a4edaf7-41c4-4e3c-91a8-62b9d7196c3f service nova] Enqueued Resource ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf with Priority: HIGHEST for action security_group_rules [ 1486.055158] env[70006]: INFO networking_nsxv3.common.synchronization [req-5f590092-0338-4318-937d-9a6750a025cb req-1a4edaf7-41c4-4e3c-91a8-62b9d7196c3f service nova] Enqueued Resource ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf with Priority: HIGHEST for action security_group_members [ 1486.055277] env[70006]: INFO networking_nsxv3.common.synchronization [req-5f590092-0338-4318-937d-9a6750a025cb req-1a4edaf7-41c4-4e3c-91a8-62b9d7196c3f service nova] Enqueued Resource ID: 085bf42e-3339-4556-90f6-03e04a11cfb5 with Priority: HIGHEST for action port [ 1486.055506] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf with Priority: HIGHEST for action security_group_rules [ 1486.055634] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf with Priority: HIGHEST for action security_group_members [ 1486.055731] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085bf42e-3339-4556-90f6-03e04a11cfb5 with Priority: HIGHEST for action port [ 1486.056337] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.056450] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.056554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.056724] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.056800] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f0e0261-a2f7-443c-bad6-28cf0dd63bdf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.057842] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.057842] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.057842] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.058017] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.058165] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.058262] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.058328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.058466] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.058549] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.058667] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f0e0261-a2f7-443c-bad6-28cf0dd63bdf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.059382] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-085bf42e-3339-4556-90f6-03e04a11cfb5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.059502] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-085bf42e-3339-4556-90f6-03e04a11cfb5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.059551] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-085bf42e-3339-4556-90f6-03e04a11cfb5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.059701] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-085bf42e-3339-4556-90f6-03e04a11cfb5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.059774] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('085bf42e-3339-4556-90f6-03e04a11cfb5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.561783] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f0e0261-a2f7-443c-bad6-28cf0dd63bdf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.562859] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.563018] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.563340] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 085bf42e-3339-4556-90f6-03e04a11cfb5 with status ACTIVE [ 1486.563506] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.563826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.563826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.563914] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.563995] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.564198] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.564298] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.564362] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.564521] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.564602] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.564785] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.564904] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.564940] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.565081] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.565158] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.565242] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 085bf42e-3339-4556-90f6-03e04a11cfb5 is going to be updated. [ 1486.585041] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.585041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.585399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.585399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.585488] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.585583] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-085bf42e-3339-4556-90f6-03e04a11cfb5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.064295] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f0e0261-a2f7-443c-bad6-28cf0dd63bdf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1487.567638] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.568062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.568062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.568062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.568189] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.568224] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf is going to be created. [ 1487.592676] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.592918] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.592918] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.593119] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.593287] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.604543] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf in Status: UNINITIALIZED for 2s [ 1489.614824] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf in Status: SUCCESS [ 1489.615128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.615233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.615454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.615651] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.615767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.615833] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.615980] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.616071] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.616194] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.616269] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f0e0261-a2f7-443c-bad6-28cf0dd63bdf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.118795] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f0e0261-a2f7-443c-bad6-28cf0dd63bdf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.622043] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf: rpc.has_security_group_logging(os_id): False [ 1490.639120] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.639365] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.639365] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.639485] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.639582] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.639827] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.639927] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.639988] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.640162] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.640239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.640328] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf is going to be created. [ 1490.695479] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.695676] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.695676] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.695897] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.696099] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.706909] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf in Status: IN_PROGRESS for 2s [ 1491.056972] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1491.057213] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1492.720835] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf in Status: SUCCESS [ 1492.721275] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.058452] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1496.058452] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1501.059341] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1501.059756] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1506.061076] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1506.061430] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1511.062640] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1511.063086] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1516.064498] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1516.064901] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1521.066081] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1521.066482] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1526.067465] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1526.067804] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1531.068398] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1531.068789] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1536.070263] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1536.070639] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1541.071246] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1541.071709] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1546.072089] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1546.072461] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1547.111494] env[70006]: INFO networking_nsxv3.common.synchronization [req-f3819b64-3c0e-4133-a2fc-27c2d06f709a req-e9352375-0d84-4803-98fc-eddf61da7f10 tempest-ServerActionsTestOtherA-1491726041 tempest-ServerActionsTestOtherA-1491726041-project-member] Enqueued Resource ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f with Priority: HIGHEST for action security_group_members [ 1547.112050] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f with Priority: HIGHEST for action security_group_members [ 1547.112357] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ac4e5f7-9493-4d97-8c74-901ee541f00f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.112511] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.112595] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.112742] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.113344] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.113344] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.113344] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.113344] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.113344] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.113344] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ac4e5f7-9493-4d97-8c74-901ee541f00f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.616051] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.616294] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.616294] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.616533] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.616628] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.616872] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.616974] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.617053] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.617209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.617289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.617376] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f is going to be updated. [ 1547.665619] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.665858] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.665858] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.666076] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.666234] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.676108] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f in Status: IN_PROGRESS for 2s [ 1549.695464] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f in Status: SUCCESS [ 1549.695865] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f deletion is rescheduled due to dependency. [ 1549.695865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.113403] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1552.113403] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1556.895844] env[70006]: INFO networking_nsxv3.common.synchronization [req-5fa281c0-ed1f-4f14-8559-7821390fae83 req-4b834854-acd7-4835-824e-3822ce8663d3 tempest-ServerActionsTestOtherA-1491726041 tempest-ServerActionsTestOtherA-1491726041-project-member] Enqueued Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_members [ 1556.896075] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_members [ 1556.896627] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.896783] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1556.896912] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1556.898223] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1556.898437] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1556.898576] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1556.898652] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1556.899203] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1556.899323] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1556.899424] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1557.167496] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.167701] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.167857] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.168164] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.168426] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.168587] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.168709] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.168927] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.169108] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.169356] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1557.169476] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1557.169588] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1557.169697] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1557.169809] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1557.169957] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1557.170080] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1557.192957] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1557.193121] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1557.193260] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1557.193443] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.193754] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-2b1ad1e3-7054-4541-8a7d-1987779f9a9a taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.193929] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-2b1ad1e3-7054-4541-8a7d-1987779f9a9a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.194074] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-2b1ad1e3-7054-4541-8a7d-1987779f9a9a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.194410] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-2b1ad1e3-7054-4541-8a7d-1987779f9a9a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.194554] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b1ad1e3-7054-4541-8a7d-1987779f9a9a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1557.401853] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.402057] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.402109] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.402333] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.402431] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.402633] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.402728] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.402792] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.402941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.403031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.403136] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 is going to be updated. [ 1557.428518] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.428713] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.428713] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.428924] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.429100] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.439466] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: IN_PROGRESS for 2s [ 1557.697586] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.697814] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.697963] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.698274] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.698436] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.698595] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 2b1ad1e3-7054-4541-8a7d-1987779f9a9a not found, creating... [ 1557.698863] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.699039] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.699166] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.699388] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.699531] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.699880] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.700076] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.700259] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.700539] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.700695] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.700841] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 2b1ad1e3-7054-4541-8a7d-1987779f9a9a is going to be created. [ 1557.720924] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.721106] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.721226] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.721464] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.721690] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.721916] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-2b1ad1e3-7054-4541-8a7d-1987779f9a9a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.382987] env[70006]: INFO networking_nsxv3.common.synchronization [req-5fa281c0-ed1f-4f14-8559-7821390fae83 req-2539c5dc-9bf6-4faa-b406-085b2bb58a77 service nova] Enqueued Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_rules [ 1558.383246] env[70006]: INFO networking_nsxv3.common.synchronization [req-5fa281c0-ed1f-4f14-8559-7821390fae83 req-2539c5dc-9bf6-4faa-b406-085b2bb58a77 service nova] Enqueued Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_members [ 1558.383320] env[70006]: INFO networking_nsxv3.common.synchronization [req-5fa281c0-ed1f-4f14-8559-7821390fae83 req-2539c5dc-9bf6-4faa-b406-085b2bb58a77 service nova] Enqueued Resource ID: 2b1ad1e3-7054-4541-8a7d-1987779f9a9a with Priority: HIGHEST for action port [ 1558.383558] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_rules [ 1558.383683] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_members [ 1558.383778] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b1ad1e3-7054-4541-8a7d-1987779f9a9a with Priority: HIGHEST for action port [ 1558.384393] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.384466] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.384515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.384722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.384816] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1558.385637] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.385730] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.385921] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b1ad1e3-7054-4541-8a7d-1987779f9a9a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.386031] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b1ad1e3-7054-4541-8a7d-1987779f9a9a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.386098] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b1ad1e3-7054-4541-8a7d-1987779f9a9a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.386261] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b1ad1e3-7054-4541-8a7d-1987779f9a9a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.386334] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b1ad1e3-7054-4541-8a7d-1987779f9a9a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1558.888592] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.888799] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.889156] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b1ad1e3-7054-4541-8a7d-1987779f9a9a with status ACTIVE [ 1558.889453] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.889630] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.889735] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.890045] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.890196] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.890509] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.890672] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.890789] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.891082] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.891238] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.891561] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.891744] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.891908] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.892719] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.892719] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.892719] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b1ad1e3-7054-4541-8a7d-1987779f9a9a is going to be updated. [ 1558.914072] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1558.914276] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1558.914386] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1558.914698] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1558.914910] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.915167] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b1ad1e3-7054-4541-8a7d-1987779f9a9a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.450984] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: SUCCESS [ 1559.452157] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 deletion is rescheduled due to dependency. [ 1559.452157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.452157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.452157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.452157] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.452157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.452157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.452157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.452157] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.452460] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1559.955197] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.457638] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.540289] env[70006]: INFO networking_nsxv3.common.synchronization [req-d6e51f74-8d8d-4f22-a380-52f6049652a7 req-9fc465f7-7a8c-4f9b-bbaf-1b25451bf638 tempest-AttachVolumeTestJSON-389518749 tempest-AttachVolumeTestJSON-389518749-project-member] Enqueued Resource ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf with Priority: HIGHEST for action security_group_members [ 1560.540965] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf with Priority: HIGHEST for action security_group_members [ 1560.541133] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.541260] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.541328] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.541523] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.541669] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.541761] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.541853] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.541965] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.542062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.542154] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f0e0261-a2f7-443c-bad6-28cf0dd63bdf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.961899] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.961899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.961899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.961899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.961899] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.961899] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 is going to be updated. [ 1560.990092] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.990092] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.990092] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.990092] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.990092] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.997855] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: IN_PROGRESS for 2s [ 1561.044307] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.044503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.044503] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.044732] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.045277] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.045593] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.045706] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.045851] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.046296] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.046391] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.046498] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf is going to be updated. [ 1561.074901] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.075086] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.075130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.075336] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.075476] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.084727] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf in Status: IN_PROGRESS for 2s [ 1563.009959] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: SUCCESS [ 1563.010257] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.010623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.010623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.011391] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.011391] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.011391] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.011391] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.011391] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.011391] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.011391] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.106107] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf in Status: SUCCESS [ 1563.106327] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf deletion is rescheduled due to dependency. [ 1563.106397] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.513861] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.514130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.514130] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.514369] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.514588] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.514588] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.514693] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.514837] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.514958] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.515066] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.515221] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.515314] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.515374] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.515517] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.515652] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.515744] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.515816] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.515941] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.516030] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.516105] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.516200] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.018389] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9e6cc58-af30-43eb-9095-6f3fa07f74c8: rpc.has_security_group_logging(os_id): False [ 1564.037603] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.037891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.037891] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.038117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.038220] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.038430] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.038529] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.038587] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.038740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.038817] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.039016] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.039117] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.039175] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.039313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.039385] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.039574] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.039664] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.039721] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.039856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.039930] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.040096] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 is going to be updated. [ 1564.099382] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.099619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.099619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.099798] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.099948] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.114470] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: IN_PROGRESS for 2s [ 1565.542593] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1565.542593] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1566.132871] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: SUCCESS [ 1566.133114] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.698016] env[70006]: INFO networking_nsxv3.common.synchronization [req-fb6d0af4-92bc-4efa-b35b-0ec967c82074 req-c5af4608-46d8-48cb-a2fd-e7b28cfc78cd tempest-ServerActionsTestOtherA-1491726041 tempest-ServerActionsTestOtherA-1491726041-project-member] Enqueued Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_members [ 1566.698962] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGHEST for action security_group_members [ 1566.698962] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.698962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.699536] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.699536] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.699536] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.699536] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.699536] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.699702] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.699737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.699823] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1566.743067] env[70006]: INFO networking_nsxv3.common.synchronization [req-fb6d0af4-92bc-4efa-b35b-0ec967c82074 req-c5af4608-46d8-48cb-a2fd-e7b28cfc78cd tempest-ServerActionsTestOtherA-1491726041 tempest-ServerActionsTestOtherA-1491726041-project-member] Enqueued Resource ID: 2b1ad1e3-7054-4541-8a7d-1987779f9a9a with Priority: HIGHEST for action port [ 1566.743576] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b1ad1e3-7054-4541-8a7d-1987779f9a9a with Priority: HIGHEST for action port [ 1566.743885] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b1ad1e3-7054-4541-8a7d-1987779f9a9a taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.744014] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b1ad1e3-7054-4541-8a7d-1987779f9a9a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.744087] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b1ad1e3-7054-4541-8a7d-1987779f9a9a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.744283] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b1ad1e3-7054-4541-8a7d-1987779f9a9a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.744367] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b1ad1e3-7054-4541-8a7d-1987779f9a9a',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.204318] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.205291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.205291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.205291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.205291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.205291] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.205291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.205291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.205638] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.205638] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.205638] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 is going to be updated. [ 1567.234632] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.234769] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.234852] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.235079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.235228] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.243594] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: IN_PROGRESS for 2s [ 1567.248967] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b1ad1e3-7054-4541-8a7d-1987779f9a9a with status ACTIVE [ 1567.249203] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.249324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.249381] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.249591] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.249678] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.249856] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.249969] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.250040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.250196] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.250270] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.250498] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.250569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.250600] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.250722] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.250787] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.250870] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b1ad1e3-7054-4541-8a7d-1987779f9a9a is going to be updated. [ 1567.270304] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.270474] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.270511] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.270704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.270900] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.270996] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b1ad1e3-7054-4541-8a7d-1987779f9a9a" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.253106] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 in Status: SUCCESS [ 1569.253552] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 deletion is rescheduled due to dependency. [ 1569.253552] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1571.744256] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1571.744675] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1576.745134] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1576.745134] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1581.746770] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1581.747228] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1586.747654] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1586.748056] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1590.091516] env[70006]: INFO networking_nsxv3.common.synchronization [req-1636b817-6a9f-46b9-a537-e5d82b2fa3a1 req-b6731e8a-9a4f-480a-99e1-3bdd037990b3 tempest-ServerActionsTestOtherA-1491726041 tempest-ServerActionsTestOtherA-1491726041-project-member] Enqueued Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_members [ 1590.092082] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_members [ 1590.092413] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.092548] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.092617] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.092849] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.093018] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.093121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.093187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.093367] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.093456] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.093551] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1590.354812] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.355051] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.355200] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.355513] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.355802] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.356014] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.356150] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.356448] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.356574] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.356980] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1590.356980] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] NeedRegenerationException {{(pid=70006) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1590.357120] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] no value, waiting for create lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1590.357284] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] value creation lock acquired {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1590.357630] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] No value present for key: 'zone-id' {{(pid=70006) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1590.357630] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Calling creation function for not-yet-present value {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1590.357694] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1590.379214] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1590.379408] env[70006]: DEBUG dogpile.cache.region [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70006) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1590.379527] env[70006]: DEBUG dogpile.lock [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Released creation lock {{(pid=70006) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1590.379716] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "network-686" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.380065] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock port-6024653f-4ed6-45dc-8bfe-02867a4a3ca8 taken with stack trace [, , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.380252] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "port-6024653f-4ed6-45dc-8bfe-02867a4a3ca8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.380381] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "port-6024653f-4ed6-45dc-8bfe-02867a4a3ca8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.380730] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "port-6024653f-4ed6-45dc-8bfe-02867a4a3ca8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.380877] env[70006]: DEBUG networking_nsxv3.api.rpc [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6024653f-4ed6-45dc-8bfe-02867a4a3ca8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1590.595371] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1590.883768] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.883768] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.883768] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.884110] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.884359] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.884563] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Segment Port 6024653f-4ed6-45dc-8bfe-02867a4a3ca8 not found, creating... [ 1590.884874] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.885098] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.885291] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.885567] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.885759] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.886143] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.886440] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.886625] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.886871] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.887121] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.887259] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Resource: SegmentPort with ID: 6024653f-4ed6-45dc-8bfe-02867a4a3ca8 is going to be created. [ 1590.910539] env[70006]: DEBUG networking_nsxv3.common.locking [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1590.910764] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1590.910896] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1590.911198] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1590.911439] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.911674] env[70006]: DEBUG oslo_concurrency.lockutils [None req-bb55d049-c4f9-4ac6-aeaf-c350d4542602 None None] Releasing lock "port-6024653f-4ed6-45dc-8bfe-02867a4a3ca8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.098663] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.578433] env[70006]: INFO networking_nsxv3.common.synchronization [req-1636b817-6a9f-46b9-a537-e5d82b2fa3a1 req-54448fe7-33e0-4d8a-af60-9c1cdd454660 service nova] Enqueued Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_rules [ 1591.578433] env[70006]: INFO networking_nsxv3.common.synchronization [req-1636b817-6a9f-46b9-a537-e5d82b2fa3a1 req-54448fe7-33e0-4d8a-af60-9c1cdd454660 service nova] Enqueued Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_members [ 1591.578433] env[70006]: INFO networking_nsxv3.common.synchronization [req-1636b817-6a9f-46b9-a537-e5d82b2fa3a1 req-54448fe7-33e0-4d8a-af60-9c1cdd454660 service nova] Enqueued Resource ID: 6024653f-4ed6-45dc-8bfe-02867a4a3ca8 with Priority: HIGHEST for action port [ 1591.578433] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_rules [ 1591.578433] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_members [ 1591.578433] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6024653f-4ed6-45dc-8bfe-02867a4a3ca8 with Priority: HIGHEST for action port [ 1591.579164] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.579164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.579164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.579164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.579164] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.579978] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.580078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.580273] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock port-6024653f-4ed6-45dc-8bfe-02867a4a3ca8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.580367] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6024653f-4ed6-45dc-8bfe-02867a4a3ca8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.580428] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6024653f-4ed6-45dc-8bfe-02867a4a3ca8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.580589] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6024653f-4ed6-45dc-8bfe-02867a4a3ca8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.580675] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6024653f-4ed6-45dc-8bfe-02867a4a3ca8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1591.601663] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.601663] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.601663] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.601663] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.601938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.601938] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 is going to be updated. [ 1591.630174] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1591.630356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1591.630356] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1591.630578] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1591.630726] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.638951] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: IN_PROGRESS for 2s [ 1592.082101] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.082326] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.084648] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6024653f-4ed6-45dc-8bfe-02867a4a3ca8 with status ACTIVE [ 1592.084844] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.084963] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.085048] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.085313] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.085383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.085562] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.085658] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.085718] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.085862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.085936] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.086126] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.086210] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.086274] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.086415] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.086486] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.086569] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6024653f-4ed6-45dc-8bfe-02867a4a3ca8 is going to be updated. [ 1592.109287] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.109677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.109677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.109677] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.109836] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.109954] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6024653f-4ed6-45dc-8bfe-02867a4a3ca8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.648556] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: SUCCESS [ 1593.648929] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.648929] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.649151] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.649341] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.649482] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.649546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.649713] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.649802] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.649879] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1594.152278] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1594.654993] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.156992] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.157281] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.157281] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.157513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.157610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.157717] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 is going to be updated. [ 1595.188055] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.188269] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.188269] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.188417] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.188568] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.198288] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: IN_PROGRESS for 2s [ 1596.578779] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1596.579193] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1597.208780] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: SUCCESS [ 1597.209074] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.209213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.209444] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.209680] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.209806] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.209870] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.210047] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.210132] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.210218] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.210307] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1597.712581] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.214910] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7afc3b6e-6fd7-4d5f-907e-545cb98529e5: rpc.has_security_group_logging(os_id): False [ 1598.233368] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.233368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.233368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.233368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.233368] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.233740] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.233740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.233740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.233740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.233864] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.233891] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 is going to be updated. [ 1598.296521] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.296800] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.296800] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.296926] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.297092] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.309993] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: IN_PROGRESS for 2s [ 1599.016986] env[70006]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1599.017430] env[70006]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-f47f9fc3-0a09-4daa-9252-4325eccb766a None None] NSXv3 Agent Agent loop - iteration:4 started [ 1600.324535] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: SUCCESS [ 1600.325041] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.579729] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1601.580112] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1606.580921] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1606.581319] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1611.582689] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1611.583303] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1616.584200] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1616.584477] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1621.585576] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1621.585996] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1626.586785] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1626.587175] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1631.587736] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1631.588212] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1636.588928] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1636.589334] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1641.590424] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1641.590796] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1644.941200] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1644.941785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1644.941785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1644.941785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1644.941785] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1645.444111] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1645.946413] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1646.448969] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1646.449173] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1646.591645] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1646.591849] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1647.188755] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.189164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.189164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.189164] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.201152] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1647.202071] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.203361] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1647.236771] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.237103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.237103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.237269] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.248425] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.249123] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1647.249235] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1647.249292] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1647.272199] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.272434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.272434] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.272608] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.273040] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.273182] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1647.345180] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.345394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.345394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.345663] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.345992] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.346275] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1647.412674] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.412852] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.412939] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.413128] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.413409] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.413681] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:8. [ 1647.413767] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'7afc3b6e-6fd7-4d5f-907e-545cb98529e5', 'a9e6cc58-af30-43eb-9095-6f3fa07f74c8', '7ac4e5f7-9493-4d97-8c74-901ee541f00f', 'f0646470-1725-4121-8506-f62005f5ece8', '6f0e0261-a2f7-443c-bad6-28cf0dd63bdf', '6541dc4e-5278-42ae-bed3-8ae1f828bb0f', 'a703014b-177b-46b0-a1e5-010ba0dfd415', 'b62110f9-4181-4c43-9e99-43fd5dff214d'} {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1647.413860] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1647.431444] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.431656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.431656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.431841] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.431929] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.432058] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1647.432140] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1647.432215] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1647.508049] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.508272] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.508272] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.508471] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.509513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.509769] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1647.509844] env[70006]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70006) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1647.509906] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1647.509976] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1647.510061] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 8/8 resources of Type:Security Group Rules [ 1647.510133] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGH for action security_group_rules [ 1647.510212] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGH for action security_group_rules [ 1647.510289] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f with Priority: HIGH for action security_group_rules [ 1647.510346] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGH for action security_group_rules [ 1647.510402] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf with Priority: HIGH for action security_group_rules [ 1647.510461] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f with Priority: HIGH for action security_group_rules [ 1647.510520] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a703014b-177b-46b0-a1e5-010ba0dfd415 with Priority: HIGH for action security_group_rules [ 1647.510584] env[70006]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b62110f9-4181-4c43-9e99-43fd5dff214d with Priority: HIGH for action security_group_rules [ 1647.510652] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1647.510714] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1647.510904] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.511019] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.511078] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.511245] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.511324] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.511497] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.511588] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.511646] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.511783] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.511856] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.512031] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.512112] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.512171] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.512305] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.512375] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.512541] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.512628] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.512679] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.512811] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.512883] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.513057] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.513147] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.513201] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.513357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.513444] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.513623] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.513716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.513766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.513893] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.513964] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.514141] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.514232] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.514289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.514421] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.514493] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.514656] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.514776] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.514838] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.514978] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.515062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.515231] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.515322] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.515382] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.515520] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.515609] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.515781] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.515872] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.515928] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.516077] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.516145] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.516310] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.516399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.516454] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.516587] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.516660] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.516824] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.516913] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.516970] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.517116] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.517188] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.517351] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.517441] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.517497] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.517676] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.517755] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.517923] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.518021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.518076] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.518213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.518284] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.518448] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.518575] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.518679] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.518714] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.518786] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.518950] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.519052] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.519103] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.519237] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.519308] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.519502] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.519605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.519605] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.519737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.519808] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.519970] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.520069] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.520122] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.520256] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.520327] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.520487] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.520575] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.520633] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.520763] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.520833] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.520995] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.521093] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.521150] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.521280] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.521350] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.521511] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.521598] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.521654] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.521785] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.521854] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.522037] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.522109] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.522169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.522302] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.522373] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.522535] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.522623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.522680] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.522810] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.522880] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.523055] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.523144] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.523201] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.523332] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.523402] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.523567] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.523656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.523712] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.523842] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.523911] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.524086] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.524172] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.524225] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.524357] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.524428] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.524590] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.524679] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.524733] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.524865] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.524935] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.525108] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.525197] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.525250] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.525383] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.525479] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.525619] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.525709] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.525763] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.525895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.525966] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.526143] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.526240] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.526295] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.526430] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.526500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.526663] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.526754] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.526807] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.526938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.527037] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.527182] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.527269] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.527331] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.527461] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.527533] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.527724] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.527809] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.527868] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.528011] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.528088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.528251] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.528338] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.528394] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.528525] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.528590] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.528786] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.528873] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.528938] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.529088] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.529159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.529323] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.529411] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.529465] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.529600] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.529672] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.529833] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.529944] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.530021] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.530150] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.530222] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.530387] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.530476] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.530532] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.530663] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.530736] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.530899] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.530987] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.531058] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.531187] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.531257] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.531418] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.531507] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.531559] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.531694] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.531767] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.531927] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.532024] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.532089] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.532213] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.532282] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.532444] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.532531] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.532584] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.532716] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.532786] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.532947] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.533046] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.533108] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.533233] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.533303] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.533466] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.533553] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.533604] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.533737] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.533808] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.533968] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.534066] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.534120] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.534253] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.534322] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.534482] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.534570] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.534627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.534756] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.534827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.534989] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.535084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.535145] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.535278] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.535349] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.535511] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.535599] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.535656] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.535786] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.535855] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.536022] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.536110] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.536166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.536296] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.536363] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.536522] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.536610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.536662] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.536793] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.536862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.537032] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.537123] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.537216] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.537308] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.537376] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.537537] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.537648] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.537704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.537841] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.537912] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.538088] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.538179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.538239] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.538366] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.538436] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.538600] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.538704] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.538759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.538896] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.538966] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.539142] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.539230] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.539291] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.539419] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.539489] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.539651] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.539740] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.539803] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.539950] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.540033] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.540200] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.540289] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.540342] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.540477] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.540546] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.540718] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.540826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.540883] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.541033] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.541110] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.541276] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.541365] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.541420] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.541554] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.541623] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.541785] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.541872] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.541925] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.542070] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.542143] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.542303] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.542392] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.542446] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.542577] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.542647] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.542809] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.542895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.542948] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.543094] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.543166] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.543284] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 1647.543343] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 1647.543415] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1647.622270] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.622474] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.622474] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.622619] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.622901] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.623203] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1647.712939] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1647.713193] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1647.713193] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1647.713331] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1647.713610] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1647.727304] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.593163] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1651.593538] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=8], Jobs=0 [ 1651.593538] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGH for action security_group_rules [ 1651.593538] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f with Priority: HIGH for action security_group_rules [ 1651.593667] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a703014b-177b-46b0-a1e5-010ba0dfd415 with Priority: HIGH for action security_group_rules [ 1651.593702] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f with Priority: HIGH for action security_group_rules [ 1651.593821] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62110f9-4181-4c43-9e99-43fd5dff214d with Priority: HIGH for action security_group_rules [ 1651.593870] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf with Priority: HIGH for action security_group_rules [ 1651.593967] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 with Priority: HIGH for action security_group_rules [ 1651.594124] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0646470-1725-4121-8506-f62005f5ece8 with Priority: HIGH for action security_group_rules [ 1651.594478] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.594613] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.594676] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.594890] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.594970] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1651.596049] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.596169] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.596230] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.596399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.596475] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ac4e5f7-9493-4d97-8c74-901ee541f00f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1651.597264] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a703014b-177b-46b0-a1e5-010ba0dfd415 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.597372] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.597433] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.597597] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.597685] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a703014b-177b-46b0-a1e5-010ba0dfd415',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1651.598577] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6541dc4e-5278-42ae-bed3-8ae1f828bb0f taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.598738] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.598826] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.598965] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.599050] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6541dc4e-5278-42ae-bed3-8ae1f828bb0f',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1651.599723] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b62110f9-4181-4c43-9e99-43fd5dff214d taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.599833] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.599896] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.600062] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.600134] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b62110f9-4181-4c43-9e99-43fd5dff214d',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1651.600800] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.600907] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.600972] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.601135] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.601208] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f0e0261-a2f7-443c-bad6-28cf0dd63bdf',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1651.601887] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.601991] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.602067] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.602214] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.602285] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9e6cc58-af30-43eb-9095-6f3fa07f74c8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1651.604602] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0646470-1725-4121-8506-f62005f5ece8 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1651.604696] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1651.604759] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1651.604918] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1651.604993] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0646470-1725-4121-8506-f62005f5ece8',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1652.110631] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.110890] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.110890] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.111084] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.111211] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.111347] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.111410] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.111515] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.111604] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.111681] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.111770] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1652.143565] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.143862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.143862] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.143982] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.154259] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.154389] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.155343] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.155462] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.156241] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.156329] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.157029] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.157125] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.157917] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.157917] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.158842] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.158842] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.164627] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.164764] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b62110f9-4181-4c43-9e99-43fd5dff214d is going to be deleted. [ 1652.165766] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.166034] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.186871] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.187025] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0646470-1725-4121-8506-f62005f5ece8 is going to be deleted. [ 1652.187962] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.188180] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.206502] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.206710] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6541dc4e-5278-42ae-bed3-8ae1f828bb0f is going to be deleted. [ 1652.207487] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.207777] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.226350] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.226497] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9e6cc58-af30-43eb-9095-6f3fa07f74c8 is going to be deleted. [ 1652.227422] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.227695] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.257659] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.257934] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.259281] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.259481] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.266457] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.266601] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.269217] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.269368] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ac4e5f7-9493-4d97-8c74-901ee541f00f is going to be deleted. [ 1652.270469] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.270764] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.298903] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.299096] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f0e0261-a2f7-443c-bad6-28cf0dd63bdf is going to be deleted. [ 1652.300387] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.300679] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.343578] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.343739] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a703014b-177b-46b0-a1e5-010ba0dfd415 is going to be deleted. [ 1652.344688] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.344957] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.345073] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.345205] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b62110f9-4181-4c43-9e99-43fd5dff214d" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.345435] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.345531] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.345607] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.345726] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0646470-1725-4121-8506-f62005f5ece8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.346285] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.346445] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.346528] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.346637] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6541dc4e-5278-42ae-bed3-8ae1f828bb0f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.361485] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.361665] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.361665] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.361954] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.362079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.362186] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9e6cc58-af30-43eb-9095-6f3fa07f74c8" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.438474] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.438746] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.438746] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.438920] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.439029] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.439159] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ac4e5f7-9493-4d97-8c74-901ee541f00f" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.439974] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.440140] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.440209] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.440513] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.440607] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.440747] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f0e0261-a2f7-443c-bad6-28cf0dd63bdf" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.467416] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.467416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.467416] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.467718] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.467718] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.467855] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a703014b-177b-46b0-a1e5-010ba0dfd415" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.617868] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1653.120161] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7afc3b6e-6fd7-4d5f-907e-545cb98529e5: rpc.has_security_group_logging(os_id): False [ 1653.138375] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.138612] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1653.138612] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1653.138827] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1653.156654] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1653.156967] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.157121] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1653.157179] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1653.157378] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1653.157462] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1653.157553] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 is going to be updated. [ 1653.222821] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1653.223181] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1653.223181] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1653.223311] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1653.223399] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1653.237749] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: IN_PROGRESS for 2s [ 1655.254578] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: SUCCESS [ 1655.254578] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.053258] env[70006]: INFO networking_nsxv3.common.synchronization [req-750ae828-0833-4429-be19-258446be4fb0 req-2e41d43a-5e3d-4222-bfcb-d470c836e8c5 tempest-ServerActionsTestOtherA-1491726041 tempest-ServerActionsTestOtherA-1491726041-project-member] Enqueued Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_members [ 1656.053435] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_members [ 1656.053767] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.053895] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.053954] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.054181] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.054332] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.054428] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.054505] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.054646] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.054739] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.054840] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1656.557537] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1657.059392] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1657.561953] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.562425] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1657.562425] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1657.562425] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1657.562544] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.562574] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 is going to be updated. [ 1657.593430] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1657.593632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1657.593632] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1657.593807] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1657.593934] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.602350] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: IN_PROGRESS for 2s [ 1659.613189] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: SUCCESS [ 1659.613569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1661.054726] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1661.055199] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1666.055382] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1666.055753] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1671.056919] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1671.057366] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1671.246892] env[70006]: INFO networking_nsxv3.common.synchronization [req-208081ed-4ba2-4fdd-ad57-23bf3479ce2b req-5c3b9a43-98b9-4668-89d1-6a09e7a124c3 tempest-ServerActionsTestOtherA-1491726041 tempest-ServerActionsTestOtherA-1491726041-project-member] Enqueued Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_members [ 1671.247486] env[70006]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 with Priority: HIGHEST for action security_group_members [ 1671.247828] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5 taken with stack trace [, , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1671.247991] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1671.248079] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1671.248278] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1671.248435] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1671.248545] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1671.248609] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1671.248768] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1671.248854] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1671.248948] env[70006]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7afc3b6e-6fd7-4d5f-907e-545cb98529e5',) {} {{(pid=70006) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1671.752392] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1671.752643] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1671.752643] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1671.752927] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1671.753058] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1671.753276] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1671.753408] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1671.753511] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1671.753711] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1671.753815] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1671.753930] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 is going to be updated. [ 1671.786964] env[70006]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70006) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1671.787500] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1671.787569] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1671.787831] env[70006]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1671.787991] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1671.796140] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: IN_PROGRESS for 2s [ 1673.808479] env[70006]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 in Status: SUCCESS [ 1673.808942] env[70006]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7afc3b6e-6fd7-4d5f-907e-545cb98529e5 deletion is rescheduled due to dependency. [ 1673.808942] env[70006]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7afc3b6e-6fd7-4d5f-907e-545cb98529e5" {{(pid=70006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1676.249232] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1676.249501] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1681.250841] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1681.251187] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1686.252592] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1686.252981] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1691.254169] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1691.254625] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1696.255906] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1696.255906] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1701.257652] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1701.257652] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1706.258997] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1706.258997] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1711.260118] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1711.260118] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1716.261385] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1716.261597] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1721.262289] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1721.262730] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1726.263261] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1726.263679] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1731.263933] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1731.264414] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1736.264687] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1736.265091] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1741.266304] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1741.266676] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1746.267375] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1746.267679] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1751.268688] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1751.268688] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1756.269703] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1756.270153] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1761.271148] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1761.271544] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1766.271847] env[70006]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1766.272232] env[70006]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0